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Abstract 


The results of formative assessments are regularly used to inform important instruetional 
decisions (e.g., targeted intervention) within a response to intervention (RTI) system of 
teaching and learning. The validity of such instructional decision-making depends, in 
part, on the alignment between formative measures and the academic content standards 
on which classroom instruction is based, as well as the technical adequacy of the 
measures used in RTI applications. In the following technical report, we describe the 
development and scaling of the easyCBM Common Core State Standards elementary 
school mathematics measures for use within an RTI framework. Within a given grade, 
math items from two distinct item pools were calibrated to a common horizontal scale 
using a 1 -parameter Rasch analysis. The results of the scaling were then used to 
construct 13 alternate forms designed to be of comparable difficulty - 3 forms designated 
for seasonal benchmark screening and 10 designated for progress monitoring. Prior and 
subsequent grade-level math items were added to the benchmark test forms as a basis for 
constructing a common vertical scale in the future. Evidence of technical adequacy is 
reported in appendices by both test form and by the full bank of CCSS items piloted and 


scaled. 
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The Development and Scaling of the easyCBM CCSS 
Elementary Mathematics Measures: Grade K 

The mathematics measures from the easyCBM interim-formative assessment system for 
grades K-8 were designed for use in a Response to Intervention (RTI) framework (Alonzo, Lai, 

& Tindal, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 2009b; Lai, Alonzo, & Tindal, 2009), 
which can be used both for whole-school improvement (Shores & Chester, 2009) as well as to 
identify students in need of special education services (VanDerHeyden, Witt, & Gilbertson, 
2007). A functional RTI system hinges on the use of measures that are aligned with adopted 
content standards, so that instructional decisions are based on results from student assessment 
that reflect what they are learning in their classrooms (Fuchs & Fuchs, 2006). The easyCBM 
measures were originally developed to align with the National Council of Teachers of 
Mathematics (NCTM) Focal Points Standards (Nese et ah, 2010), that were adopted by many 
states as the basis for teaching mathematics. 

In 2010 the Common Core State Standards (CCSS) were released as a guide for preparing 
students for college and careers (National Governors Association Center for Best Practices & 
Council of Chief State School Officers, 2010). The subsequent endorsement of the standards by 
the U.S. Department of Education (2010) and their recommendation of creating assessments that 
provide improved measurement of student progress toward skills outlined in the CCSS, 
coincided with a majority of states adopting the CCSS as the basis for student instruction and 
assessment (National Governors Association Center for Best Practices & Council of Chief State 
School Officers, 2010). Similarly, developers of curriculum-based measurements (CBM), long 
used to monitor growth toward general outcomes and skill mastery through multiple short, 
technically adequate, and sufficiently equivalent test forms (e.g., Deno, 2003; Tindal, 2013), also 


easyCBM CCSS Kindergarten Math Measure Development 


2 


began work to align their measures with the CCSS. A study of existing easyCBM math 
measures to determine the extent to which they were in alignment with the CCSS followed in 
2012 (Irvin, Park, Alonzo, & Tindal, 2012a, 2012b; Park, Irvin, Alonzo, & Tindal, 2012). 

The 2012 alignment studies found reasonable alignment between the easyCBM 
mathematics measures and the CCSS for grades K-5; however, gaps across specific grade-level 
domains and standards remained. Identification of these gaps provided the basis for developing 
new technically adequate K-5 CCSS-aligned math items and test forms for use in the easyCBM 
interim- formative assessment system and in RTI application - the development, piloting and 
scaling of which are discussed in this technical report. 

Methods 

In developing the easyCBM CCSS mathematics measures, we focused on alignment with 
the CCSS and accessibility for diverse student populations with a range of achievement levels. 
The following section outlines the process we used to develop math items and subsequently 
assemble benchmarking and progress monitoring test forms for use in RTI frameworks of 
teaching and learning. 

Item Development 

The K-5 CCSS in mathematics are comprised of four (Grades 1 and 2) or five (Grades K, 
3-5) domains that are further divided into 21-28 individual standards. Though some grade- 
level standards were further divided into more granular sub-standards, such sub-standards were 
treated as part of the larger standard; thus, an item written to a given sub-standard was 
considered as being written to its parent standard. A total of 3,000 new CCSS math items were 
written, 500 items in each of grades K-5, based on the gaps in CCSS coverage identified through 
previous research (Irvin et ah, 2012b; Park et ah, 2012). 
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Item writing and review training. Two groups were reeruited to develop CCSS math 
items based on their experience and expertise in mathematics teaching and learning. Four item 
writers for each of three grade bands; K-1, 2-3 and 4-5, and six item reviewers, one for each of 
grades K-5, were recruited. One of the original four item writers voluntarily dropped from the 
study, and thus, two item writers split their duties within the grade 4-5 band. Writers and 
reviewers were recruited to develop and review math items appropriate to their expertise. On 
average, item writers and reviewers had about 14 years of teaching experience in math education, 
ranging from 3-32 years. Each item writer/reviewer held a Bachelor’s degree and 16 of the 18 
(including all reviewers) also held a Master’s degree. Item writers were recruited in a manner to 
balance expertise across general and special education classrooms. All item reviewers had 
demonstrated expertise in both general and special education and also worked in district 
leadership positions, for example, as math coaches or curriculum developers. 

In December 2012, item writers and reviewers attended one of four mandatory 2.5-hour 
training webinars, led by the lead project researcher, who was onsite at the offices of Behavioral 
Research and Teaching (BRT) at the University of Oregon. The webinar training consisted of 
two main sections. An initial study overview reviewed the context of the research study and 
described item writing and reviewing duties in detail. Specifically, for each new CCSS math 
item, item writers and reviewers were required to write a stem (question or prompt) and three 
answer choices (one correct and two distractors) that were similar in length and complexity level. 
When constructing distractor options, writers and reviewers were informed that they should be 
relevant to the math skills required by the problem - ideally targeting a range of plausible student 
mistakes. Item writers and reviewers could also include graphics for the stem and/or answer 
options when relevant to the problem. When graphics were called for, item writers provided a 
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rough sketch and/or description of the graphic, and a graphic artist later created digital images 
for each of the graphics. The second training section focused on techniques around effective and 
appropriate item writing, and included principles of quality item/test development as outlined by 
Haladyna (2004) and Downing (2006a, 2006b), and those around Universal Design for 
Assessment (e.g., precise construct targets, accessibility to diverse populations, lack of bias) as 
outlined by Thompson, Johnstone, and Thurlow (2002). 

Throughout each section of the webinar training, item writers and reviewers were 
required to collaboratively participate in activities designed to ensure deep understanding of 
study roles, including observation and discussion of math items. In other words, a variety of 
math items were shown to writers and reviewers, followed by a discussion of why they met or 
did not meet the principles of quality item/test development or why they were (or were not) 
aligned to the CCSS. The lead researcher, writer and reviewers brainstormed and discussed 
specific ways in which items could be altered to meet item design principles or better align to an 
identified CCSS in instances where non-examples were shown. Particular attention was paid to 
crafting effective distractor options and graphics options associated with math items. Effective 
multiple-choice items typically have one distractor option that is “closer” to the correct response 
and one distractor that is “further” from the correct response (Haladyna, 2004) - the third 
response option being the correct answer for a given math item. Graphics, whether for the stem 
and/or answer options, are included for a math item only as necessary to meet a targeted content 
standard and to critically consider and solve a given math problem. This was the manner in 
which writers were asked to write answer options and include graphics for this study. At the end 
of the training webinar, the item writing process was again described in detail, including the 
specific roles of item writers and reviewers, in connection with expected timelines and 
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deliverables. The PowerPoint Slides used in the webinar training were adapted from those used 
in Anderson, Irvin, Patarapiehayatham, Alonzo, and Tindal (2012), and are shown in Appendix 
A. 

Item writing. In general, item writers and reviewers worked eoneurrently to write, edit 
and revise 500 new CCSS-aligned math items (four item sets) in each of grades K-5. 

Specifically, item writers wrote 250 new math items; 125 items (in each of two items sets) for 
each grade of their assigned grade band (i.e., K-1, 2-3 or 4-5). For example, “item writer 1” was 
assigned to write 125 math items in each of Grades K and 1 to align with the targeted CCSS. 
Table 1 displays the math item writing plan for Kindergarten by item set and CCSS. Item writers 
iteratively wrote and submitted items to the lead researcher (and item reviewers) in small batches 
between January and March 2013, typically submitting between 10-25 items at a time for further 
review and editing. Throughout the iterative item writing process, item writers and reviewers 
were in contact with the lead researcher by email and phone to hone their skills, and thus, the 
quality and consistency of math items produced. 

Item review. We conducted three separate stages of item review prior to item scaling; 

(a) review by contracted item reviewers, (b) an internal review by University of Oregon 
education researchers at BRT, and (c) an external review by individuals without prior connection 
to the items. The first review took place concurrently with item writing, in which a single item 
reviewer was assigned to review all 500 math items for a given grade level (K-5). Prior to 
contracted item reviewers receiving items, the lead researcher briefly reviewed the small batches 
of submitted items for completeness, accuracy and features consistent with effective item writing 
discussed during the webinar training (e.g., effective items. Universal Design for Assessment), 
subsequently passing them to the assigned reviewer concurrent with the item writing process. 
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Item reviewers then carefully reviewed and edited each grade level math item for completeness, 
accuracy and features consistent with effective item writing discussed during the webinar 
training - this included editing for distractor and graphical option appropriateness. Further, 
because item reviewers had access to 125 items from each of four item writers, they also edited 
math items that were too similar (across item writers) while attempting to maintain the content 
and skill intention of the item writers. 

For the second stage of item review, all math items (subsequent to graphics development 
- see below) were uploaded to a secure website to be reviewed as students would see them in the 
online easyCBM formative assessment environment. Math items were then assigned and 
reviewed internally by a group of university education researchers from BRT. Reviewers 
included university faculty and doctoral students in education research with experience in test 
and item development. During the internal review, reviewers again analyzed and edited items 
for mathematical correctness while also looking for possible bias or features inconsistent with 
Universal Design for Assessment principles. Additionally, internal reviewers ensured that all 
items were formatted in a consistent manner. All reviewers during this stage had been trained 
and taken part in a previous internal review of middle school math items (Anderson et ah, 2012), 
and thus, were deemed competent to serve on the internal review team in the current study. A 
team of external reviewers without prior connection to the item development conducted the final 
item review. We contracted with three individuals who did not have item writing or mathematics 
teaching/assessment experience to review math items (on the secure website) for mathematical 
accuracy, consistent formatting, and audio file accuracy (see below). Our intention behind this 
manner of external review was to have a “fresh look” at the math items apart from the item 
writers, various reviewers and the lead researcher, all of whom had had considerable prior 
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contact with the math items. 

Graphics and audio development. We contraeted with a professional graphies artist to 
produee images for all math items. The artist used Adobe Illustrator to develop simple and elear 
line drawings without shading consistent with Universal Design for Assessment 
reeommendations (Thompson et ah, 2002). The artist produeed graphies only when explieitly 
requested by the item writer/reviewer - a development option for the stem and/or the answer 
options for a given math item. The artist produced each item graphie based on either a detailed 
written description or a hand-drawn/electronic version (e.g., a jpeg found on the Internet) 
provided by an item writer/reviewer. Graphie images were iteratively edited based on feedbaek 
from the three review stages. We also contraeted an individual to produce audio recordings of 
written text in all math items. In the easyCBM online assessment system, students have the 
option to eliek on a speaker button next to the stem and/or distraetor answer, whieh results in 
having the text-based portions of the item “read-aloud” to them. Audio recordings were 
reviewed and revised as necessary during the second and third review stages during item 
development. 

Scaling 

We carried out four primary steps during the sealing of the new K-5 CCSS math items: 

(a) developing a piloting plan, (b) seleeting anchor items from the existing NCTM-based 
easyCBM and the new CCSS math item pools to create pilot forms, (c) reeruiting subjects and 
piloting the items, and (d) calibrating grade-level items to a eommon scale. 

Piloting plan. For eaeh of grades K-5, we developed a eommon piloting plan, comprised 
of 15 total pilot forms, to guide pilot form creation. We included 32 total math items in each 
form for grade K-1, and 41 total items for grades 2-5. Of the 32 or 41 items in a given pilot 
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form, we dedicated 5 horizontal anchor items to link to the previous pilot form and 5 horizontal 
anchor items to link to the subsequent pilot form. For example, pilot form 2 had 5 anchor items 
linking to pilot form 1, and 5 anchor items linking to pilot form 3. This meant that there were 22 
unique math items in each of the grade-level pilot forms for grades K-1, and 31 for grades 2-5. 
Of the 10 total anchor items within a given pilot form, 5 were selected from the existing 
easyCBM item pool - items originally written to the NCTM Focal Point Standards (Nese et ah, 
2010), though deemed aligned to the CCSS in recent alignment studies (Irvin et ah, 2012b; Park 
et ah, 2012), and 5 were selected from the new CCSS-based item pool. For simplicity and 
clarity, these two pools will hereto be referred to as NCTM and CCSS item pools, though it 
should be noted that all items used in this project from both pools had been deemed aligned to 
the CCSS (the full combined CCSS item bank). 

By including horizontal anchors from both item pools, we were able to more than double 
the size of the overall item pool from which we would select items to create the operational 
CCSS test forms by calibrating the two original pools to a common scale. Additionally, this 
saved valuable item writing and review resources. It should be noted that unlike the piloting 
plan used for the easyCBM CCSS middle school math measure development study (see 
Anderson et ah, 2012), vertical (across-grade) anchor items were not included in the K-5 
piloting. Rather, we included prior- and subsequent-grade math items in the operationalized test 
forms for grades 1-5 (and prior-grade items for grade K) in order to calibrate a common scale 
over the 2013-2014 academic year, reasoning far more students would provide item-level 
information for the operationalized items as a basis for future review of technical adequacy of 
items and test forms (see form creation, below). The K-2 piloting plan, showing the number and 
placement of horizontal anchor items selected from both the existing NCTM as well as the CCSS 


easyCBM CCSS Kindergarten Math Measure Development 


9 


item pools, is displayed in Table 2. 

Choosing anchors and creating pilot forms, A team of four researehers (including the 
lead researcher) collaborated to select the anchor items from the NCTM and CCSS pools for 
pilot forms. One of the researchers had a Ph.D. in Educational Measurement and Evaluation, 
and two were doctoral students in the University of Oregon’s Educational Methodology, Policy, 
and Leadership program. The researcher with the Ph.D. and both doctoral students were familiar 
with the math item development and items, as they had worked with the lead researcher during 
item writing and had served on the internal item review team. 

As mentioned earlier, anchor items for the current piloting were selected from two 
different item pools by four researchers. Items selected from the K-5 NCTM pool had been 
previously piloted and scaled (Alonzo et ah, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 
2009b; Lai et ah, 2009), and thus, item-level information was available to guide anchor selection. 
Researchers followed a number of guidelines when selecting anchor items from the NCTM pool. 
Anchor items were selected to balance estimated difficulty across all 15 pilot forms (easy, 
medium, hard), while also falling within the acceptable range of mean-square outfit values (0.5 
to 1 .5) recommended for reliable measurement in high-stakes multiple-choice test construction 
(Wright & Linacre, 1994). 

A further constraint for selection of anchor items from the NCTM pool was that they be 
aligned to the CCSS. Based on results from Irvin et al. (2012b) and Park et al. (2012), we cross- 
walked NCTM Focal Point Standards and CCSS that were associated with each other when 
NCTM-written items were deemed aligned to particular CCSS in the alignment studies. In this 
manner, items originally written to the NCTM Focal Point Standards, though not necessarily 
included in the 2012 alignment studies, were deemed aligned to the CCSS and included in the 
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pool from which we selected anchor items in the current study (in addition to those items 
specifically deemed aligned in the earlier studies). Lastly, we attempted to stratify anchor items 
selected from the NCTM pool by CCSS. For instance, in Grade K there are 5 different CCSS 
domains with a total of 37 unique anchor items needed to populate the 15 pilot forms; thus, 7-8 
items were selected from each CCSS domain in Grade K and stratified across pilot forms as 
evenly as possible. 

Empirically estimated item-level information was not available for items in the new 
CCSS pool; thus, it was impossible to know the difficulty or mean-square outfit of items in the 
K-5 CCSS pool to guide anchor selection. Therefore, we adopted the same anchor item selection 
process used in our previous easyCBM CCSS middle school math item development study (see 
Anderson et ah, 2012, p. 9 and 22), whereby our team of four researchers worked together to 
select appropriate anchor items for pilot forms based on: (a) an appropriate number of steps 
required to respond to the item (typically 2-3), (b) minimal language requirements outside of that 
needed to solve the math problem, (c) culturally unbiased (e.g., a blend of diverse names, 
avoiding overrepresentation of subject matter unrelated to the targeted math knowledge/skills), 
(d) direct alignment to targeted CCSS, and (e) consistency with principles of Universal Design 
for Assessment. As was the case for anchor items selected from the NCTM pool, those selected 
from the CCSS pool were stratified by CCSS domain in an attempt to balance representation 
within and across each grade-level pilot form. 

After we selected horizontal anchor items, we created 15 pilot forms for each of grades 
K-5. For all grades, the first 4 items of each pilot form were unique items written to the CCSS as 
part of this study. The next 10 items (items 5-14) of each form were horizontal anchor items. 

We populated items 5-9 with anchor items selected from the NCTM pool, and items 10-14 with 
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anchor items selected from the CCSS pool. For both bands of anchor items (5-9 and 10-14), 
either 2 or 3 items linked to previous or the following pilot forms as shown in Table 2. It should 
be noted that pilot forms 1 and 1 5 shared either 2 or 3 horizontal anchor items between them, 
given they were at the “ends” of the line of forms (i.e., form 15 served as the “previous” form to 
form 1 and vice versa). In keeping with the recommendations of Kolen and Brennan (2004), the 
placement and order of each anchor item were held constant on a given pilot form. Finally, the 
unique items were last: items 15-32 for grades K-1, and 15-41 for grades 2-5. All unique items 
were stratified within and across pilot forms by standard and domain as appropriate and possible 
to balance content representation. 

Participant recruiting and participation. Over the winter and spring of 2013, teachers 
from K-5 classrooms were recruited to participate in the pilot individually and at the district level 
through the easyCBM (http://www.easycbm.com) and BRT websites (http://www.brtproiects.org 
/about /current-research), and through existing research cooperative relationships around the 
country. To protect confidentiality, districts, schools and teachers interested in participating 
were informed in writing that identifying information (e.g., demographics) would not be 
collected on students or teachers, and only information relevant to meeting research partnership 
status would be collected at the school and district levels (e.g., the total number of participating 
students per district or school). At the same time, interested participants were also given general 
details concerning the piloting process, described more specifically below, to make clear the 
study requirements. 

A minimum of 200 student responses per item is desirable to obtain stable and accurate 
item calibrations using the 1 -parameter logistic Rasch model in a concurrent equating design, as 
was used in the current study. To fulfill this minimum response requirement, we needed to 
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recruit 3000 students (15 forms * 200 responses) for each of grades K-5. We were, however, 
constrained by the end of the academic calendar and recruitment resources, and thus, we did not 
meet the minimum desirable response requirements for each form (and item). In total, 7,700 
students and 329 teachers from 140 schools, in 132 districts, across 33 states participated in the 
piloting portion of the study that began on May 15, 2013 and ended on June 15, 2013. The 
following number of students participated in the pilot by grade: 731 (grade K), 1,124 (grade 1), 
1,136 (grade 2), 1,685 (grade 3), 1,499 (grade 4) and 1,525 (grade 5). Final pilot participation 
statistics by grade and form are given in Table 3. 

Piloting process. Once they agreed to participate, teachers were given detailed 
instructions on how to access the secure piloting website, how to have their students select the 
appropriate grade level (K-5), and how their students would begin and take the online test. 
Students were instructed to use scrap paper as necessary, but not to use calculators to complete 
any math items. Once students selected their appropriate grade, they were shown a title screen 
that prompted them to begin the test by clicking an onscreen button when ready. Students were 
then immediately administered one of 15 grade-level pilot forms. The administered test form 
was automatically assigned by the piloting website, based on the number of students who had 
completed that form previously. In other words, students were assigned the grade-level pilot 
form with the fewest number of completions across all students in the pilot. Student responses 
(a, b, or c) were automatically recorded in a secure online database based on which response 
option a student selected, with the position in which the three answer options (a, b, or c) were 
displayed on the students’ computer screens randomized each time an item was administered. 
Given that pilot forms were assigned based on the number of times they had been completed and 
that answer options were randomly rotated each time an item was administered, cheating was a 
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limited concern. A screen capture of a Kindergarten math item demonstrative of how all items 
displayed on the pilot website (and indeed the K-8 easyCBM formative assessment system) is 
shown in Figure 1. 



Figure 1. Screen capture of math item illustrating online display of math items in the pilot study 
and easyCBM assessment system. 

Item calibration. All math items, including those from the larger and previously- 
existing NCTM pool, were calibrated to the same scale using a 1 -parameter logistic (IPL) Rasch 
model in a concurrent equating design using Winsteps 3.6.8 (Linacre, 2009). In the Rasch 
model, a special case of the 1 -parameter logistic model in which the item discrimination 
parameter is constrained to 1.0 and student ability is freely estimated (Linacre, 2008), all item 
and student parameters are estimated simultaneously from a single data file that contains all 
student responses, grades K-5. The concurrent equating design estimates student ability based 
on their responses to items, treating any non-responses as missing. Items are placed on the same 
scale through the inclusion of anchor items across grade level forms, displayed in Table 2. 
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The Rasch model is defined as 


Pi^is 


^\0s.Pi) = 


exp[(6>s-/?i)] 

l+exp[(6>s-/?i)] 


( 1 ) 


where: 

P = probability, 

Xis = the response of student s to math item i, 

6s = the estimated ability of student s, and 

Pi = the estimated difficulty of math item i (DeMars, 2010). 

We chose the more parsimonious IPL Rasch model because it appears to fit these data 
well, and also because we had a large final item bank of CCSS math items (full CCSS item bank) 
for grades K-5, which we analyzed for functioning and used to construct the operational 
easyCBM test forms. In other words, we had a surplus of items from which to construct test 
forms, enabling us to eliminate those items that did not function well from the full CCSS item 
bank. 


Test form creation. Within each of grades K-5, we constructed 13 alternate test forms 
designed to be of comparable difficulty (3 to be used as seasonal benchmark screening tests and 
10 to be used as progress monitoring tests) to make up the CCSS Math portion of the easyCBM 
formative assessment system. All test forms consisted of items that appeared to function well, 
while counterbalancing CCSS domain representation within and across each grade level form as 
possible. To construct the test forms, we first eliminated all items from the full CCSS item bank 
that appeared to not fit the IPL Rasch model with regard to estimated mean square outfit. 

Wright and Linacre (1994) simulated and analyzed hundreds of datasets, recommending that 
mean square outfit values between 0.5 and 1.5 could be interpreted as productive for 
measurement purposes for multiple-choice test construction, with values > 2.0 considered 
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degrading to the measurement system. As an initial step in test form eonstruction, we thus 
eliminated any item from contention that had mean square outfit smaller than 0.49 or greater than 
1.49. 

After eliminating such items, within each grade we sorted the remaining items in 
ascending order by the associated CCSS domain and the estimated difficulty of items (easiest to 
most difficult). Within each grade, there were either 4 (grades 1 and 2) or 5 (grades K, 3-5) 
CCSS domains we attempted to counterbalance within and across test forms. Thus, we 
attempted to select the same number of items from each CCSS domain across the 13 test forms at 
a given grade level, though this was not possible in all instances, as some CCSS domains were 
underrepresented relative to others. To accomplish counterbalancing CCSS domain 
representation while maintaining form comparability, we selected sets of 13 items of roughly 
comparable difficulty. We sought a range of difficulty between these selected item sets, 
including items with “reach” into the easier end of the difficulty spectrum, being cognizant that 
the operational tests would be used to assess diverse student populations, from both the special 
education and general education populations, within an RTI framework. In terms of the layout 
of selected math items within test forms, we clustered items within CCSS domain, and then 
ordered them from easiest to most difficult. We reasoned that construct- irrelevant variance 
would likely be lessened if students were jumping between domains less often, and if the math 
skill requirements of problems “ramped up” from lower- to higher-order within each domain. 

The final step in the test form creation process was our selection of horizontal anchor 
items between grade level seasonal benchmarks to allow for within-year growth estimation, and 
vertical anchors between seasonal benchmarks across grades as a basis for constructing a 
developmental scale score after the 2013-2014 academic year. The same team of four 
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researchers who selected anchors during piloting, selected anchor items for the operational test 
forms using the same process and guidelines previously described because they were intimately 
familiar with the math items and the item/test development process. 

We selected horizontal anchor items for each benchmark using a within-grade linking 
design. Within each grade, 5 horizontal anchors were selected to link the fall and winter 
benchmarks, and 5 to link the winter and spring; thus, each fall and spring benchmark test form 
had 5 horizontal anchor items, while the winter test had 10. Horizontal anchor items were 
selected from those items already making up the benchmark tests at that point in the test form 
creation process. At this point, we had constructed 13 test forms designed to be of comparable 
difficulty in each of grades K-5, each test form consisting of 25 (grades K-2) or 30 (grades 3-5) 
math items. 

We then selected vertical anchor items from the constructed test forms, adding 5 (grade 
K) or 10 (grades 1-5) math items to the end of each benchmark test in a manner that linked 
adjacent grade level benchmarks of the same season. For example, we selected 5 first grade 
math items from the fall benchmark to add on to the end of the fall Kindergarten benchmark 
(linking fall grade K to fall grade 1). When a grade was adjacent to two other grades (i.e., grade 
3 is adjacent to both grades 2 and 4), additional vertical anchors were appended to the end of the 
seasonal benchmark test forms. For example, the third grade fall benchmark included 5 vertical 
anchor items from the second grade fall benchmark and 5 items from the fourth grade fall 
benchmark. Within each test form, adjacent grade-level vertical anchor items were ordered from 
easiest to most difficult based on the estimated difficulty of each item - the same manner in 
which unique and horizontal anchor items were ordered with respect to CCSS domain - and 
were appended to the end of each seasonal benchmark in the order of subsequent and then prior 
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grade, respectively. This pattern of vertical anchor linking prior and adjacent grades continued 
for all seasonal benchmarks for each of grades K-5 (and also grades 6-8, though those results are 
not included in this series of technical reports). Student responses to vertical anchor items over 
the 2013-2014 academic year will serve as the basis for constructing a cross-grade 
developmental scale as we move toward the reporting of a scale score in future years. 

Results 

As a result of item development and test creation efforts described in this study, we 
constructed 13 alternate test forms; 3 designated for seasonal benchmarking and 10 designated 
for progress monitoring, in each of grades K-5. We designed the test forms to be aligned with 
the CCSS in mathematics, to be of comparable difficulty within grade, and to be accessible for 
diverse student populations with a wide range of achievement. We loaded K-5 tests into the 
easyCBM database for use as online formative CCSS math assessments and released them for 
use in fall 2013. 

The results of our analyses are reported separately by grade (K-5), each in its own 
technical report. For Kindergarten, each seasonal benchmark consists of 30 total math items, 
including 5 vertical anchor items linked to the respective grade 1 benchmarks. Each progress- 
monitoring test form consists of 25 unique math items. The item difficulties for each of the 13 
Kindergarten test forms are displayed in Table 4. 

Item Statistics 

We present the results of the IPL Rasch analysis in ascending order by test form and for 
the full CCSS Kindergarten item bank in Appendices B and D, respectively. When examining 
item information in these appendices, it is important to highlight two statistics critical to 
evaluating item functioning within the context of Rasch-based test development: the estimated 
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difficulty and indicator of discrimination. The difficulty parameter, in equation 1, represents 
the estimation of how difficult item i is relative to all other items in the analytic sample, with 
approximate possible values ranging from -3 (easiest items) to +3 (most difficult items) in the 
standardized scale - the same scale on which student ability {6^ is reported (DeMars, 2010). An 
estimated difficulty equal to 0 could then be interpreted as a student with average ability would 
have an equal probability of getting the answer correct as incorrect. Individual item difficulties 
are averaged across forms, representing an average difficulty of each test form as displayed in 
Table 4, to evaluate form equivalence. The average difficulty across all 13 Kindergarten test 
forms is 0.022 (range = 0.006 to 0.037), or slightly above average difficulty. The second statistic 
that warrants highlighting is the indicator of item discrimination. As noted earlier, the IPL 
Rasch analysis constrains the discrimination parameter to 1.0 (DeMars, 2010; Linacre, 2008). 
Though discrimination statistics are included for each item in Appendices B and D, it is 
important to distinguish that this item statistic is not a true estimation o/item discrimination, but 
rather an rough indicator o/item discrimination, approximated during a post-hoc calculation by 
WINSTEPS (Linacre, 2008). Interpretation of discrimination values in IPL Rasch analysis is the 
same as those freely estimated in, for example, a 2-parameter logistic model; though, caution is 
warranted given they are merely rough indicators in this study. Discrimination values >1.2 are 
considered very high (more productive for measurement purposes), while values < 0.5 are 
considered very low, when item difficulty and student ability are estimated in the standardized 
scale (DeMars, 2010), as is the case in our analysis. 

Distractor Analysis 

We present response option statistics in ascending order by test form and for the full 
CCSS Kindergarten item bank in Appendices C and E, respectively. Interpretation of statistics 
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within these appendiees is similar to item level interpretation, but is presented for eaeh of the 
three response options. We eoded the eorreet response option as A for all items, while the * 
represents missing data (those students ineluded in the analytie sample who did not respond to 
the given item either by ehoiee, if administered the pilot form eontaining the item, or simply 
beeause they were not administered that form). We analyzed distraetors, seeking to retain well- 
funetioning items in whieh students with the highest average estimated ability seleeted the 
eorreet answer ehoiee, thus demonstrating the highest average person measure, while students 
with lower average estimated ability seleeted one of the remaining answer options. As deseribed 
earlier, we attempted to write items with one near distraetor and one far distraetor. Items 
funetioning well would thus demonstrate near distraetors with average person measure values 
slightly below that of the eorreet response option and far distraetors with lower average person 
measure values. 

Discussion 

As instruetion in publie sehools aeross the United States moves in eloser alignment with 
the CCSS, it is important for formative student assessment to also move in that direetion given 
that the results of sueh assessment are regularly used to inform instruetional deeision-making 
within RTI eontexts. To a growing degree, the validity of instruetional deeision-making in these 
contexts depends on both the alignment between adopted formative assessments and the CCSS 
and also the technical adequacy of such assessments. In this series of technical reports, we 
described the development and scaling of the easyCBM CCSS Math assessments for grades K-5, 
designed for use within an RTI framework of instruction and formative assessment in elementary 


classrooms. 
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Table 1 


Kindergarten Item Writing Plan by CCSS Standard 


CCSS standard 

Item Set 1 

Item Set 2 

Item Set 3 

Item Set 4 

Existing 
BM Align 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CCS 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CC5 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

G1 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

G3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MDl 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBTl 

25 

25 

25 

25 

1 

100 

OAl 

5 

5 

5 

5 

3 

20 

OA2 

5 

5 

5 

5 

3 

20 

OA3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set total 

125 

125 

125 

125 

79 

500 


Note. Item Sets 1-4 reflect items written to each CCSS standard based on results from our 
previous alignment study (Irvin et ah, 2012b), reflected in Existing BM Align column. Total 
represents the number of math items written to a given CCSS standard in the current study. 
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Table 2 


Grades K-2 Piloting Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

22 

32 


Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

NIO 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

22 

32 


Note. C = CCSS pool anchor item; N = NCTM pool anchor item. Anchor items appearing in a vertical column (both CCSS or 
NCTM) were shared between the specified forms. For example, form 3 and form 4 shared 3 anchor items from the CCSS pool (set 
C3) and 2 from the NCTM pool (set N3). 
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Table 3 


Grades K-5 Piloting Participation Statistics 



Grade K 



Grade 1 



Grade 2 


Form 

Completed 

Started 

Form 

Completed 

Started 

Form 

Completed 

Started 

1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form Average 

49 

57 

Form Average 

75 

90 

Form Average 

76 

97 


Grade 3 



Grade 4 



Grade 5 


Form 

Completed 

Started 

Form 

Completed 

Started 

Form 

Completed 

Started 

1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form Average 

112 

161 

Form Average 

100 

122 

Form Average 

102 

129 


Note. Many test forms were started though not completed, thus, the number of student responses per item varies within form, as shown in Appendices B and D. 
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Table 4 


Kindergarten Item Difficulties by Test Form (without adjacent grade vertical anchor items) 


Item # 

PMl 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PMIO 

BMF 

BMW 

BMS 

Mean 

1 

-1.84 

-2.21 

-2.10 

-2.01 

-1.97 

-1.95 

-1.95 

-1.93 

-1.89 

-1.89 

-1.87 

-2.17 

-1.87 

-1.973 

2 

-0.89 

-0.90 

-0.90 

-0.91 

-0.92 

-0.97 

-0.97 

-1.03 

-1.00 

-1.01 

-1.02 

-1.02 

-0.99 

-0.964 

3 

0.31 

0.29 

0.34 

0.38 

0.29 

0.29 

0.32 

0.40 

0.35 

0.39 

0.32 

0.32 

0.34 

0.334 

4 

0.60 

0.58 

0.50 

0.50 

0.58 

0.50 

0.58 

0.50 

0.57 

0.53 

0.54 

0.54 

0.54 

0.543 

5 

1.30 

1.38 

1.29 

1.40 

1.23 

1.46 

1.26 

1.38 

1.20 

1.37 

1.32 

1.33 

1.33 

1.327 

6 

1.61 

1.76 

1.91 

1.61 

1.93 

2.00 

1.67 

1.69 

2.04 

1.88 

1.61 

1.70 

1.70 

1.778 

7 

-0.29 

-0.22 

0.20 

-0.05 

-0.20 

0.19 

0.15 

-0.27 

0.11 

-0.20 

-0.26 

-0.28 

-0.28 

-0.108 

8 

-2.06 

-2.02 

-2.05 

-1.99 

-1.87 

-1.76 

-1.78 

-1.66 

-1.69 

-1.62 

-1.51 

-1.55 

-1.57 

-1.779 

9 

-0.82 

-0.83 

-0.83 

-0.89 

-0.83 

-0.84 

-0.91 

-0.92 

-0.91 

-0.92 

-0.79 

-0.79 

-0.80 

-0.852 

10 

-0.46 

-0.41 

-0.39 

-0.40 

-0.44 

-0.35 

-0.38 

-0.39 

-0.37 

-0.38 

-0.51 

-0.50 

-0.50 

-0.422 

11 

0.16 

0.17 

0.17 

0.19 

0.22 

0.22 

0.26 

0.26 

0.35 

0.37 

0.10 

0.11 

0.11 

0.207 

12 

0.69 

0.80 

0.80 

0.68 

0.58 

0.56 

0.55 

0.49 

0.49 

0.46 

0.51 

0.54 

0.54 

0.592 

13 

-1.65 

-1.63 

-1.48 

-1.48 

-1.43 

-1.43 

-1.43 

-1.39 

-1.38 

-1.35 

-1.34 

-1.31 

-1.31 

-1.432 

14 

-1.01 

-1.00 

-0.99 

-1.00 

-1.00 

-0.98 

-0.92 

-0.92 

-0.97 

-0.95 

-1.06 

-1.06 

-1.04 

-0.992 

15 

-0.46 

-0.41 

-0.44 

-0.40 

-0.36 

-0.35 

-0.37 

-0.40 

-0.42 

-0.44 

-0.35 

-0.35 

-0.34 

-0.392 

16 

0.25 

0.21 

0.18 

0.31 

0.30 

0.33 

0.31 

0.27 

0.25 

0.34 

0.22 

0.22 

0.22 

0.262 

17 

1.67 

1.69 

1.70 

1.86 

1.82 

2.01 

1.89 

1.80 

1.50 

1.48 

1.60 

1.61 

1.63 

1.712 

18 

-1.65 

-1.67 

-1.70 

-1.74 

-1.74 

-1.85 

-1.98 

-1.96 

-1.91 

-1.88 

-1.64 

-1.64 

-1.60 

-1.766 

19 

-0.68 

-0.68 

-0.69 

-0.72 

-0.79 

-0.80 

-0.82 

-0.83 

-0.83 

-0.84 

-0.68 

-0.67 

-0.67 

-0.746 

20 

-0.20 

-0.32 

-0.30 

-0.29 

-0.29 

-0.27 

-0.26 

-0.25 

-0.25 

-0.24 

-0.24 

-0.24 

-0.24 

-0.261 

21 

0.26 

0.32 

0.32 

0.33 

0.33 

0.34 

0.35 

0.36 

0.37 

0.38 

0.29 

0.29 

0.32 

0.328 

22 

1.12 

1.02 

0.98 

0.99 

0.96 

0.98 

1.00 

1.03 

1.06 

1.09 

1.13 

1.11 

1.04 

1.039 

23 

0.59 

0.54 

0.65 

0.58 

0.38 

0.43 

0.76 

0.31 

0.30 

0.70 

0.66 

0.67 

0.67 

0.557 

24 

1.24 

1.26 

1.30 

1.38 

1.34 

1.40 

1.41 

1.44 

1.50 

1.49 

1.19 

1.21 

1.21 

1.336 

25 

2.56 

2.42 

2.27 

2.26 

2.13 

1.93 

1.90 

2.60 

1.77 

1.76 

2.70 

2.64 

1.81 

2.212 

Mean 

0.014 

0.006 

0.030 

0.024 

0.010 

0.044 

0.026 

0.023 

0.010 

0.021 

0.037 

0.028 

0.010 

0.022 


Note. PMl to PMIO = Progress Monitoring Form 1 to Form 10; BMF = Benchmark Fall, BMW = Benchmark Winter, BMS = Benchmark Spring; Green = 
horizontal anchor items. 
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Appendix A: Training Materials 
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Common Core State Standards (CCSS) 
Math Item Writing and Review 

Supplementing the easyCBM math 
assessment system 


easyCBM 

• easyCBM is an online benchmark and progress 
monitoring assessment system. 

• Designed to inform teachers' classroom-based 
instructional decisions 

• Used within Response to Intervention (RTI) 
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easvCBM in Use 

• What are your experiences with easyCBM? 

Popularity of the System 

• Registered users in all 50 states 

• Over 2 million students in the system 

• Over 800,000 teachers in the system 

• Growing exponentially 

• Over 9000 new registered teacher users every 
month; with district-level subscribers growing 


Within RTI (yery general) 



Standards, instruction and assessment must align 
for accurate decision-making and inferences! 
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Item 


Before we get too far: 
Vocabulary 


(Question) 

Stem 


What color was Sandra's ball?^ 


Correct response 


b)green 


c)yellOW Incorrect distracters 

Answer (or response) Optionj 



Project Overview 

• Develop 3,000 new math items for easyCBM 

in grades K-5; 500 items per grade 

- Aligned with the Common Core State Standards 
(CCSS) 

— Piloted in April/May to examine their technical 
adequacy and establish difficulty 

— Developed items will be assembled with existing 
items that were aligned to CCSS into 20 test forms 
per grade (60 forms total). 

- Each form will have 25 items for use in easyCBM 

- Anticipated release date of Fall 2013 
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Existing Items vs. Items to be Developed 

Existing Items 

Items to be Developed 

• Originally developed for the 

• Should be developed for 

2% population (i.e., 

students performing at or 

students performing well 

slightly below grade-level 

below grade-level 

expectations. 

expectations) 

• Aligned to the NCTM Focal 
Point Standards 

• Aligned to the CCSS 


Common Core Standards (see PDF) 

Grade K 

Standard Domains 

• Counting and Cardinality (KCC) 

• Operations and Algebraic Thinking (KOA) 

• Number and Operations in Base Ten (KNBT) 

• Measurement and Data (KMD) 

• Geometry (KG) 

24 standards divided among 5 domains. 
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Outline of GrK Items to be Written/Reviewed 



Item Set 2 

hern Set 3 

hern Set 4 

hem Set 5 

CCSS BM Alien 

Tec^ 

XI 

5 

5 

6 

6 

0 

22 

X2 

i 

1 

1 

1 

6 

4 

X3 

i 

f 

5 

5 

1 

22 

X4 

1 

1 

1 

1 

5 

4 

xs 

5 

5 

6 

6 

3 

22 

xs 

1 

1 

1 

1 

5 

4 

X7 

i 

i 

S 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

S2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

S4 

1 

1 

1 

1 

5 

4 

SS 

u 

u 

10 

10 

0 

42 

Si 

1 

1 

1 

1 

8 

4 

MDl 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

1 

MD3 

19 

19 

19 

19 

4 

76 

NBTl 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

S 

S 

5 

3 

20 

DA3 

5 

5 

5 

5 

0 

20 

DA4 

S 

S 

5 

5 

1 

20 

DAS 

5 

S 

S 

5 

3 

20 

SetTot^ 

12S 

12S 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 1 

Standard Domains 

• Operations and Algebraic Thinking (lOA) 

• Number and Operations in Base Ten (INBT) 

• Measurement and Data (IMD) 

• Geometry (IG) 


21 standards divided among 4 domains. 
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Outline of Grl Items to be Written/Reviewed 



hern Set 2 

kern Set 3 

hem Set* 

hern Sets 

CCSSBMAfan 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 



6i 

12 

11 

11 

11 

1 

45 

MOl 

8 

8 

8 

8 

1 

32 

kjoi 

8 

8 

8 

8 

0 

32 

yoa 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

5 

29 








MBT7 

1 

2 

1 

1 

5 

5 

N6T3 

10 

10 

10 

10 

2 

40 



0 





M6TS 

M 

10 

10 

10 

0 

40 

M6T6 

10 

10 

10 

10 

0 

40 


- 

- 





OA2 

6 

6 

7 

6 

4 

25 







u 

QA4 

6 

6 

8 

7 

1 

25 

QA3 

6 

7 

8 

6 

1 

25 








0*7 

6 

6 

7 

6 

0 

25 

0*1 

7 

6 

8 

6 

5 

25 

Set Total 

125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 2 

Standard Domains 

• Operations and Algebraic Thinking (20A) 

• Number and Operations in Base Ten (2NBT) 

• Measurement and Data (2MD) 

• Geometry (2G) 


26 standards divided among 4 domains. 
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Outline of Gr2 Items to be Written/Reviewed 



leem Set 2 

knnSet3 

tafnSet4 

kem Set 5 

CCSS BM Alien 

Total 

ei 

10 

10 

U 

11 

0 

42 

B2 

10 

U 

10 

10 

3 

41 

B3 

11 

u 

10 

10 

0 

42 








MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

MD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

MD7 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MDIO 

4 

4 

4 

3 

0 

15 








NVT2 

5 

5 

5 

S 

0 

20 

Nen 

5 

5 

5 

S 

0 

20 








NB15 

1 

1 

1 

2 

5 

5 

N0T6 

5 

S 

5 

S 

0 

20 

NBT7 

5 

s 

5 

5 

2 

20 

N6T8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

S 

0 

20 

OAl 

2 

1 

1 

1 

7 

5 

□A2 

10 

10 

10 

10 

3 

40 

DAS 

10 

10 

10 

10 

0 

40 

DM 

10 

10 

10 

10 

1 

40 


125 

125 

12S 

125 


500 


Common Core Standards (see PDF) 

Grade 3 

Standard Domains 

• Operations and Algebraic Thinking (30A) 

• Number and Operations in Base Ten (3NBT) 

• Number and Operations-Fractions (3NF) 

• Measurement and Data (3MD) 

• Geometry (3G) 

25 standards divided among 5 domains. 


easyCBM CCSS Kindergarten Math Measure Development 


36 

Appendix A: Training 


Outline of Gr3 Items to be Written/Reviewed 



hern Set 2 

kem Set 3 

kemSet4 

Item Sets 

CCSS IM Alien 

Total 

QAl 

5 

5 

5 

5 

3 

20 

OA^ 

o 

D 

□ 

o 

s 

L 

OA3 

0 

0 

0 

0 

6 

0 

BM 

5 

s 

5 

s 

4 

20 

QM 

5 

5 

5 

9 

2 

2D 

DM 

S 

5 

5 

s 

9 

2D 

0A7 







OAI 

5 

5 

5 

5 

3 

20 








NBTl 

8 

9 

9 

8 

0 

34 

MBT2 

9 

• 

8 

I 

0 

33 

MBTl 

• 

8 

■ 

9 

1 

33 


u 

u 

u 

u 

li 

u 

Wl 

20 

20 

20 

20 

1 

» 

NF) 

5 

5 

5 

5 

5 

20 

MOl 

3 

3 

3 

4 

0 

13 

M02 

4 

3 

3 

3 

0 

13 

M03 

3 

3 

4 

3 

0 

13 

MM 

3 

4 

3 

3 

0 

13 

MOS 

3 

3 

3 

3 

0 

12 

MM 

3 

3 

3 

3 

1 

12 

M07 

3 

3 

3 

3 

0 

12 

MM 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

80 

G2 

5 

5 

5 

S 

15 

20 


125 

125 

125 

12S 


500 


Common Core Standards (see PDF) 

Grade 4 

Standard Domains 

• Operations and Algebraic Thinking (40A) 

• Number and Operations in Base Ten (4NBT) 

• Number and Operations-Fractions (4NF) 

• Measurement and Data (4MD) 

• Geometry (4G) 

28 standards divided among 5 domains. 
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Outline of Gr4 Items to be Written/Reviewed 



Iton Set 2 

Item Set 3 

kern Set 4 

hem Set 5 

CCSS BM Alien 

Total 

Ml 

f 

6 

6 

7 

1 

25 

M2 

3 

3 

2 

2 

5 

10 

M3 

5 

5 

5 

5 

5 

20 

M4 

i 

6 

7 

8 

0 

25 

MS 

s 

5 

5 

5 

3 

20 

NVTl 

4 

4 

4 

3 

1 

15 

HBT2 

4 

3 

4 

4 

1 

15 

NBT3 

4 

4 

3 

4 

1 

IS 

NffT4 

5 

S 

5 

5 

0 

20 

NffTS 

4 

4 

3 

4 

3 

15 

NBT6 

S 

S 

S 

5 

0 

20 

NFl 

3 

4 

4 

4 

1 

15 

NF2 

4 

4 

4 

3 

1 

15 

Nf3 

4 

3 

4 

4 

1 

15 

Mf4 

S 

S 

S 

5 

A 

20 

m 

s 

5 

s 

5 

• 

20 

>4F6 

0 

0 

0 

0 

8 

u 

m 

s 

4 

4 

4 

2 

IS 

IMl 

1 

1 

2 

2 

i 

» 

MD2 

0 

0 

0 

0 

16 

0 

MU 

2 

2 

1 

1 

s 

10 

MD4 

S 

S 

s 

s 

0 

20 

MD5 

s 

5 

5 

5 

0 

20 

MD6 

s 

S 

5 

5 

0 

20 

MD7 

5 

S 

5 

5 

1 

20 

SI 

• 

t 

8 

8 

0 

33 

S2 

1 

8 

8 

9 

0 

33 

S3 

1 

9 

9 

8 

0 

34 


12S 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 5 

Standard Domains 

• Operations and Algebraic Thinking (50A) 

• Number and Operations in Base Ten (5NBT) 

• Number and Operations-Fractions (5NF) 

• Measurement and Data (5MD) 

• Geometry (5G) 

26 standards divided among 5 domains. 
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Outline of Gr5 Items to be Written/Reviewed 



Item Set 2 

Item Set 3 

Item Set 4 

Item Set 5 

CCSSBMAJiot 

Total 

OAl 

9 

9 

8 

8 

1 

84 

0A2 

S 

8 

8 

9 

0 

33 

OA3 

S 

8 

9 

8 

0 

33 

Nsri 

3 

4 

4 

4 

2 

15 

NKT2 

4 

4 

4 

3 

2 

15 

Nvn 

5 

S 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

s 

5 

S 

5 

0 

20 

NBTt 

4 

4 

3 

4 

3 

IS 








FI 

0 

0 

0 

0 

9 

0 

NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

NFS 

S 

5 

S 

5 

0 

20 

NFS 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MDl 

7 

7 

8 

8 

0 

30 

MD2 

S 

8 

7 

7 

0 

30 








M04 

5 

5 

5 

5 

3 

20 

M05 

5 

5 

5 

S 

4 

20 

G1 

7 

6 

6 

8 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

S3 

6 

6 

7 

8 

0 

25 

G4 

6 

7 

6 

8 

0 

25 


12S 

12S 

125 

12S 


500 


Why So Many New Items? 

1. No matter how perfect an item looks, there 
are always quirks. 

— We need 250-300 "good" items per grade. 

— If we write 500 items per grade, we can "weed 
out" the poor items. 

2. The surplus of items also allows us to 
assemble items into test forms (i.e., seasonal 
benchmarks and progress-monitoring) of 
comparable difficulty. 
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Purpose 1 

Example: Two Similar Items 

Item 1 Item 2 


A. 

6 

15 

A. 4 

B. 

8 

R ^ 
16 

C. 

X 

in 

C. 1 


Purpose 1 

Example (continued) 

• Although the previous two items look very 
similar, our statistical analyses of the items 
functioning indicate that Item 1 is functioning 
quite well, while Item 2 is functioning quite 
poorly. 

• Item 2 was determined to be functioning poorly 
enough that it was removed 

• Despite the similarities in item construction, the 
students' responses to the items are very 
different (i.e., matching student ability w/ 
question difficulty). 
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Purpose 1 
Recap 

Item 1 Item 2 




B i Good Item Poor Item 

Why? It's difficult to say for sure, but is part of why we need to write a 
surplus of items 


Purpose 2 
RTI 

• RTI requires multiple test forms of equivalent 
difficulty 

• If forms are not equivalently difficult, 
assumptions about the growth students make 
and/or the effectiveness of instruction or an 
intervention may not be accurate 


easyCBM CCSS Kindergarten Math Measure Development 


41 

Appendix A: Training 


Purpose 2 
(Continued) 

• Growth? 

-What if first three 
forms were unusually 
difficult and the last 
two forms were 
unusually easy? 

• We need to have a sufficient number of items 
to ensure that forms actually are, statistically 
speaking, equivalently difficult. 


Wold fU«dbg FluMicy: Jul» 



1*44 Great 

S IB 

■ », — * " 

38 _ 

#- 




.f' ✓ / << 

Data 

Or*«l 30 nn<ttaro«coatM*r 


I0»m • '30»s SOMt Mnt 


Your Role As the Item Writer and 
Item Reviewer 

A Concurrent Process of Item 
Writing, Reviewing, and Submission 
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Your role as the Item Writer 

• Become an "item writing expert" 

— Thoroughly review the CCSS associated with the 
grade-band you have been assigned (i.e., K-1, 2-3, 
and 4-5). 

— Review "example items" in ItemSet spreadsheet. 

• Complete two ItemSet spreadsheets, 
consisting of 125 items for each grade of your 
assigned grade band (i.e., 125 grade K items, 
and 125 grade 1 items for K-1 grade band) 

• Thoroughly review all items written before 
turning items in to BRT (in batches). 


Your role as the Item Reviewer 

• Become an "item writing expert" 

— Thoroughly review the CCSS associated with the 
grade that you have been assigned (i.e., K, 1, 2, 3, 
4, or 5). 

— Review "example items" in ItemSet spreadsheet. 

• Review and edit 500 grade-level items from 
the 4 ItemSets (in batches). 

• Thoroughly review all items written before 
turning items in to BRT (in batches, by 
ItemSet). 
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Excel ItemSet Template cont. 

• Each ItemSet consists of 125 items 

• Item Writers will write all 125 items and fill out the 
excel sheet. 

— After writing items into the excel file, the Item Writer 
should add an underscore and their initials after the 
version number to save it 

• e.g.. Item Writer = Shawn Irwin: 

G2ltemSet2.xlsx G2ltemSet2_Sl.xlsx 

• Each Item Writer will write items to specific CCSS, 
most times multiple items per standard 

• The number of items per domain will vary by Item 
Writer and grade. 


Excel ItemSet Template 


mi »#- 'vvti't'i 






Ml* 4» * 

ruM 

SMI Mcrttr «*•<« cs. 


«m»»l M 


Write one Question (stem) and three 

Answer options in these ceils 

* Option A Is always the correct 
answer 

* Oottons B and C are always 
incorrect, but plausible distractor 
responses 


The "home" for all of the items we write and review! I ! 
These ItemSet spreadsheets will be passed from Writers to 
me to Reviewers and back to me for an in-house review. 
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Item ID Naming Convention 


- - . n<wii>— mt— »»»■ — 1 Bw-Tun aciwOTii 







2G1.1 = Grade 2 - Geometry domain - Standard 1 - Item 1 
2G1.2 = Grade 2 - Geometry domain - Standard 1 - Item 2 
Two items, same domain/standard! 


Item ID Naming Convention 

• It is crucial that all items written are filled out 
in the excel sheet appropriately 

• Graphics accompanying an item MUST BE 
given the same ID because the graphic is part 
of the item. 

— If the wrong ID is assigned to the graphic, it will 
either be lost or accompany the wrong item. 
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Graphics (images) in Items 

• First rule of graphics - they are expensive 

- Adds, on average, around $50 to the total cost of the 
item 

• Does this mean graphics should not be used? 

- No, but it does mean that graphics should only be used if 
they (a) increase the clarity of the item or (b) are 
essential to the content of the item (i.e., in geometry) 

- Graphics may be necessary for some standards! 

• There is also no clear research on the effect of 
adding a graphic to an item (Kettler, Elliott, & 
Beddow, 2009) 


Graphics in Items (cont.) 

• Graphics can be in question/stem, and/or in 
ansv\/er options! 

• If you as an Item Writer or Reviewer want to 
add graphics, they have two options: 

1. Describe what the graphic will look like in detail in 
the excel sheet (recommended if the graphic is 
simplistic). 

2. Draw the graphic by hand or use clipart from the 
web in the "Graphics Template" provided. 
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Describe what the graphic will look like in 
detail in the excel sheet (recommended if the 
graphic is simplistic). 




tt ttftm <■»* ■' - - - , - - 

XI>M«a pM«aNr> >CiMi»nl *?*?** ^ 

SSJTiSiTSr^ 

r:, 

Ktm Mt> m ■ fw 

rrtfra «»»i 





tacar<« «« Moa Miaq 

MtfMMiMet MO • > t«r> 

!«■*■«•> leaa n *w ntwtir fi—i»l 

WM» 




i*aM» M <i mMm m % H 

mt^m. awM-t uwOi »«■ 





Protocol for Hand Drawn Graphics 

• Draw the graphic by hand using "Graphic Template" 

• Matching Item ID exactly! 


Note: the 
unique Item 
ID 


Iteni 





J ui 


ci«m_ 8 >”'« 


© S:Tn':J CA] 
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Protocol for Hand Drawn Graphics 
(as it is seen in easyCBM) 



The head is a 


A. inan^ 

B. circle 

C. square 


Protocol for Hand Drawn Graphics 

• Use clipart from the web and enter into "Graphics 
Template" 

http://www.fotosearch.com/ 



Note. We will not use any of the clipart in the actual items, 
but it is a way to communicate approximately what the 
graphic should look like. 
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Use Basic Codes in ItemSet Spreadsheets 

(see ExampleSheet K-5CCSS.docx for more) 

• Image: [img]item_7NS3008.png[/img] 

• Division symbol: 3 -r 4 = 3[divide]4 = 3[div]4 

• Long division: 3[longdiv]42[/longdiv] 

• Square roots: V25 = [squareroot]25[/ 
squareroot] 

• Pi: Jt = [pi] 

• Vertically stacked add/sub/multiply: 

[plus]30:40:12[/plus] 30 

40 
+ 12 


Excel Sheet (see Example Problems) 
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The Basic Process 

Item Writers: 

• You will write and turn items in batches, 
approximately ~20-40 items at a time, and email 
them to me for a quick check for completeness 
and quality, with all 250 items, two completed 
ItemSet spreadsheets due by Friday, January 11^^, 
2013. 

• I will email OKd items to Item Reviewers. 

• Item Reviewers will individually be reviewing, 
editing ajl items for ways to improve them, and 
returning them to me, but they should be a 
strong as you can get them before emailing them 
to me. 


The Basic Process (cont.) 

Item Reviewers: 

• After you have reviewed/edited all items in an 
item set and deemed them to be (a) aligned to 
the standard, (b) mathematically accurate, (c) 
grade-level appropriate, (d) free of bias, and (e) 
"good" overall items, you turn in the ItemSet 
spreadsheet to me at BRT. 

• Email items back to me in batches, a full ItemSet 
(i.e., 125 group of grade-level items from a single 
Item Writer) at a time you will turn in a total 
of four of these for your grade, with all ItemSets 
due by Friday, January 25**^, 2013 
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Deadlines and Compensation 

• Compensation will be released upon completion 
of your work, pending approval by BRT and the 
University of Oregon (me) 

• $800 for Item Writers completing two ItemSets 
of 125 items each, 250 total January, 

2013 

• $1500 for Item Reviewers for reviewing/editing 
500 grade-level math items January, 25*^ 
2013 


Study-related or 
Procedural 
QUESTIONS? 
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Some Basic Item Writing 
Guidelines 
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Whv multiple 

choice items? 

“Selected-response items are the most appropriate item 

format for measuring cognitive achievement or ability, 

especially higher order cognitive achievement or cognitive 

abilities, such as problem solving, synthesis, and 

evaluation.” (Downing, 2006, p. 288) 

• Validity 

• Efficiency 

— Less chance of 

— Easy to administer 

construct irrelevant 

— Easy to produce 

variance in scores 

— Easy to score 

— Allow a given skill 

objectively (as 

to be assessed 

opposed to 
constructed 

multiple times 

response item 

(multiple items) 

types) 


How do you write a good item? 

Art or SCIENCE? (maybe a little of both) 


Answer Options : 

• Use only 3 options: 1 
correct response and 2 
distracters 

• Choose logical distracters 

• Avoid excess text or 
irrelevant features 


Assess Only Target Knowledge : 

• Targeting Math 

• Reduce language as much as 
possible 

• If the item is supposed to 
assess fractions, make sure it 
doesn't assess other factors, 
such as conversions or 
estimations. 

Be Sensitive of Bias Issues : 

• Keep in mind the population of 
students who will be taking the 
items 

• Consider ELL, SWD, diverse 
cultures, etc. 
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Universal Design 

How should we design a building so the widest range 
of populations possible can access it? 



Universal Design for Assessment 


• Considers all characteristics of test-takers. 

• Precisely defined constructs. 

• Accessible, non-biased items. 

“’Terns’^’^'daBTeToTcTo’^ ] 

• Simple, clear, and intuitive instructions and | 

procedures. I 


Maximum readability and comprehensibility. 
Maximum legibility of text, tables, figures, and 
illustrations 


Thompson. Johnstone, and Thurlow (2CXJ2) 
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Tablet 

A Revised TEuconomy of Muftiple-Choice (MC) Kem-Writing Guidelines 


Content concerns 

1 . Evefy item should reflect specific content and a single ^)ecitic mental behavior, as called for in 
test specifications (two-way grid, lest blueprint). 

2. Base each item on important content to learn: avoid trivial content 

3. Use novel material to test higher level learning. Paraphrase textbook language or language used 
during instruction when used in a test item to avrnd testing for simply recall. 

4. Keep the content of each item independent from content of other items on the test 

5. Avoid over specific and over general content when writing MC items. 

6. Avoid opinion-based items. 

7. Avoid trick items. 

8. Keep vocabulary simple for the group of students being tested. 

Formatting concerns 

9. Use the question, completion, and best answer versions of the conventional MC. the alternate 
choice, true-false (TF). multiple true-false (MTF). matching, and the context-dependent item 
and item set formats, but AVOID the complex MC (Type K) formaL 

10. Format the item vertically instead of horizontally. 

Style concerns 

11. Edit and proof items. 

12. Use correct grammar, punctuation, capitalization, and spelling. 

13. Minimize the amount of reading in each item. 

Writing the stem 

14. Ensure that the directions in the stem are very clear. 

15. Include the central idea in the stem instead of the choices. 

16. Avoid window dressing (excessive verbiage). 

17. Word the stem positively, avoid negatives »ich as NOT or EXCEPT. If negative words are used, 
use the word cautiously and always ensure that the word appears capitalized and boldface. 


TABLE! 

A Flevised Taxonomy of Multiple'Choice (MC) Item-Wrrting Guidelir>es 


Writing the choices 

1 8. Develop as many effective choices as you can. but research suggests three is adequate. 

19. Make sure that only one of these choices is the right answer. 

20. Vary the location of the right answer according to the number of choices. 

2 1 . Place choices in logical or numerical order. 

22. Keep choices independent: choices should not be overlapping. 

23. Keep choices homogeneous in content and grammatical structure. 

24. Ke^ the length ofchoices about equal. 

25. None-vf-the-abave should be used carefully. 

26. Avoid All-of-ihe-above. 

27. Phrase choices positively: avoid negatives such as NOT. 

28. Avoid giving clues to the right answer, such as 

a Specific determiners including always, never, completely, and absolutely. 

b. Clang associatioAs. choices identical lo or resembling words in the stem. 

c. Cjraromatical inconsistencies that cue the test-taker to the correct choice. 

d. Conspicuous correct choice. 

e. Pairs or triplets of options that clue the test-taker to the correct choice. 

f. Blatantly absurd, ridiculous options. 

29. Make all distractors plausible. 

30. Use Epical errors of students to write your distractors. 

3 1 . Use humor if it is compatible with the teacher and the learning environment. 


Haladyna, 2002, p. 312 
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Content Concerns 

“Every item should reflect specific content and a single 
specific cognitive process” (Haladyna, 2004, p. 98). 
Guidelines 

• Write/review items that align with only one standard 
(or one part of one standard), and that the item 
targets that standard clearly and directly. 

— Target only one skill in each item. If standard asks for 
multiple skills, use multiple items. 

• Try not to be over-specific or over-general. 

• Try not to "trick the students" 

• Each item should be independent of all others. 

• Avoid focusing items on trivial parts of standards. 

• Present items in novel formats 

Note. The following slides are largely based on Haladyna, 2004. 


Targeting Only One Skill 

standard 6.SP: Recognize that a measure of center for a numerical data set summarizes all of 
its values with a single number, while a measure of variation describes how its values vary with 

a single number. 


Example item 1 

Example item 2 

Which number 

Which number 

describes the center of 

describes the center of 

the dataset? 

the dataset? 

Dataset: 5, 7, 3, 3 

Dataset: 5, 7, 3, 3 

A) Average - 4.50 

A) 4.50 

B) Standard deviation - 1.91 

B) 1.91 

C) Range -4.00 

C) 4.00 
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Targeting Only One Skill 

Example item 1 

Example item 2 

• The first item provides the 

• Second item requires 

student with the name of 

student to both know the 

the statistic AND the 

best statistic (average) AND 

number. 

to recognize which number 

• The target skill of the item 
(measure of central 

represents that statistic. 

tendency) is not confused 

• Item has less text, but in 

with other math skills. 

this case, the text may help 

HOWEVER - 
• Item still requires 

vocabulary and additional 
reading skills over a simpler 
version 

target the skill of interest. 


Targeting Only One Skill 

• Both items target only one part of the 
standard (central tendency), yet item 2 still 
targets multiple math skills. 

— Note: if we were interested in knowing students' 
skills with calculating the average, we could easily 
address it with a different item. 

Example 

The average of: 4, 3, 9, 4 = ? 

- A) 5 

- B) 20 
-C)4 
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Over-specific/Over-general 

Over-specific item 

Over-general item 

Who wrote the Icon ofSeville7 

Which is the most serious 

A) Lorca 

problem in the world? 

B) Ibanez 

A) hunger 

C) Rodriguez 

B) lack of education 

C) disease 

Over-specific items often assess 

Over-general items are often 

trivial content. 

opinion-based. 

Balancing the generality of an item is 

part of the "art" of writing good items. 

Note. Examples from hialadyna, 2004, p. 102. 


Trick Questions 

• Is there a fourth of July in England? 

Yes, there is a fourth of July everywhere. 

• Some months have 31 days. How many have 
28? 

All of them 

• How many animals of each gender did Moses 
bring on his ship? 

None. Moses didn't have a ship, Noah did. 

• A butcher in the meat market is six feet tall. 
What does he weigh? 

Meat 

Note. Examples from Halacfyna, 2004, p. 104. 
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Trick Questions 

“There are enough problems in testing 
without contributing more by using trick 
items.” (Haladyna, 2004, p. 104) 


Formatting Concerns 

• Make sure stem is a complete sentence/ 
directive. 

• Make sure item is multiple choice, and 
contains three options (correct response and 
two plausible distracters). 

• Correct response is always answer Option A 

— Because items will be computer-administered, we 
will randomly rotate all options. For development 
purposes, it's easiest to always keep the correct 
response in a consistent location. 

All other formatting concerns are BRT responsibility 
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Style Concerns 

• Please proof read all items you wrote before you 
turn them over to me (both Writers and 
Reviewers) 

• Primary things to look for: 

— Grammar 

— Can the reading load be reduced without losing 
clarity? 

— Is there more than one construct/skill? 

— Bias and sensitivity (i.e., variety of diverse names - 
Google them!) 


Stem Construction 

• Try to be as clear and concise as possible 

• Make sure the stem is complete and contains 
all the information needed to solve the 
problem. 
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Developing Options (correct option 
and two plausible distractors) 

• Probably the most difficult part of an item to 
develop. 

• Answer options must be reasonable and have 
only one justifiably correct answer (e.g., if you 
can make a reasonable argument that one of 
the distracters is also correct, it is not a good 
distracter). 

• You're an expert!!! Think about the common 
math mistakes your students make! 


Developing Options (cont.) 

In a perfectly functioning item... 

• Stem contains all the information needed to 
solve the question 

— Answer option A is the correct response, and will be 
chosen by students who understand the content 
targeted by the item. 

— Answer option B is a close distracter, and will be 
chosen by students who have partial, but incomplete 
knowledge of the content targeted by the item. 

— Answer option C is a far distracter (but not TOO far), 
and will be chosen by students who have little to no 
knowledge of the content targeted by the item. 
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Developing Options (cont.) 

• Keep format of each option the same (length, 
grammar, etc.) 

• Do not use "all of the above" or "none of the 
above" 

• Keep distracters plausible, but avoid hinting at 
the correct response. 

• Try to use distracters that represent typical 
student errors 


Developing Options (cont.) 

• Although guidelines can help, coming up with 
reasonable options is difficult. Getting the 
options to all function the way they are 
intended to is even more difficult. 

— Why some refer to item writing as an o/t (as 
opposed to a science) it's a little of both 
though! 


easyCBM CCSS Kindergarten Math Measure Development 


63 

Appendix A: Training 


Hypothetical Example 

• Imagine a kindergarten or first grade standard 
that requires students have knowledge of 
basic geometric shapes - faces, sides, angles, 
etc. 

— i.e., squares, circles, triangles, rectangles, etc. 


Item Non-Example 

Greq and Sally were both In the firet grade. Greg 
liked the color blue and always wore a blue shirt. 
Sally liked the color green and always wore a 
green shirt. Which shirt has more triangles on 
It? 



a) blue c) Sally e) triangles 

b) green d) Greg 
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Why this is a poor item 

• Way too much text 

• Lots of irrelevant information 

• Low-cognitive-level question (basically counting - 
though some standards this skill is targeted) 

• What if the student is color blind? 

• Too many options 

— Not logical distracters 

— There is arguably more than one correct response 
option (either blue or Greg) 

• Doesn't really address the standard 


Item non-example 2 

Triangles: 

a) have three sides 

b) have two long sides and two short sides 

c) have rounded edges 

d) all of the above 

e) none of the above 
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Why this is a poor item 

• stem does not present the information 
needed solve the problem. 

• Uses the "all of the above" and "none of the 
above" options 

— Although there is some empirical evidence 
supporting that the "all of the above" option 
increases the difficulty (Huang, Trevisan, & 
Storfer, 2007), the general consensus is that it 
creates a "cueing" effect for students. Also, 
students may choose these options with mis- or 
partial knowledge. 
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Why is this a better item? 

• Clearly addresses the standard 

• Low level of text 

• No irrelevant information 


Language Issues 


For math items, excess text threatens validity 

— Particularly worrisome for English language 
learners (ELL) 


What to do? 


— Use familiar, grade- 
level appropriate 
words 

— Omit all unnecessary 
words 

— Use no text if possible, 
or keep sentences as 
brief as possible 


— Avoid conditional 
and relative clauses 

— Avoid negation 

— Use concrete 
versus abstract 
representation 
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Now.... Time to look at some real items! 

Existing easyCBM items 


Existing easyCBM items 

• Note. There's only a limited amount we can 
learn from these items 

— Aligned to different standards 
— Developed for a different population 

However 

• Formatting will be similar 

• Universal design features evident 

• Good item writing principles applied 

• Perhaps most important - We know they work! 
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Existing easyCBM item 

standard: Solve problems about similar objects (including figures) by using scale 
factors that relate corresponding lengths of the objects or by using the fact that 
relabonships of lengths within an object are preserved in similar objects. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 

A. 4 in. Remember: These items were designed for very low 

B, 4 in. performing students. The new items should target 

c. 5 in. students at or slightly below grade-level expectations. 



Existing easyCBM item 

standard: Use descriptive statistics, including mean, median, and range, to summarize 
and compare data sets. 



B. $9 

C. $12 


• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 
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One more... 

standard: Explain why the sum of the measures of the angles in a triangle Is 180 
degrees, and they apply this fact about triangles to find unknown measures of angles. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignnnent? 

• Other concerns? 

A. 38° 

B. 71° 

C. 16* 



How do you become a good item writer? 

“Effective item writers are trained, not 
born... Although item writers must be 
expert in their own disciplines, there is no 
reason to believe that their subject matter 
expertise generalizes to effective item 
writing expertise.” 

(Downing, 2006, p. 11) 
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Bottom line 

“Practice does not make perfect. Only 
perfect practice makes perfect.” 
-Vince Lombardi 

• Practice, practice, practice, 

— Practice writing different types of items 

• Geometry, number & operation, etc. 

— Look back at other test items 

• Find examples of good and bad items 


Resources 

• Multiple choice item writing Do's and Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations portion of the following 
IDEA paper 

— http://www.theideacenter.org/IDEAPaperl6 

Plenty more resources online can be found with 
a quick Google search. 
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Appendix B: Item Statistics by Test Form 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

30135 

-1.84 

17 

15 

1.12 

0.81 

-0.03 

0.25 

-0.32 

0.71 

1.19 

1 

2 

30718 

-0.89 

118 

103 

0.30 

1.14 

0.75 

1.09 

0.36 

0.22 

0.89 

1 

3 

30711 

0.31 

15 

10 

0.70 

0.62 

-1.18 

0.45 

-0.90 

0.74 

1.60 

1 

4 

KG318 

0.60 

48 

28 

0.31 

0.96 

-0.35 

0.93 

-0.49 

0.38 

1.18 

1 

5 

30583 

1.30 

22 

14 

0.53 

0.77 

-0.99 

0.64 

-0.80 

0.66 

1.45 

1 

6 

KG339 

1.61 

48 

25 

0.32 

1.04 

0.39 

0.98 

-0.06 

0.40 

0.92 

1 

7 

KMD336 

-0.29 

51 

42 

0.40 

0.78 

-0.91 

0.53 

-1.13 

0.55 

1.26 

1 

8 

K0027 

-2.06 

18 

17 

1.16 

0.50 

-0.55 

0.13 

-0.56 

0.50 

1.33 

1 

9 

K0002 

-0.82 

119 

97 

0.25 

0.85 

-1.02 

0.74 

-0.89 

0.41 

1.19 

1 

10 

K0019 

-0.46 

18 

14 

0.69 

0.72 

-0.79 

0.47 

-0.70 

0.64 

1.42 

1 

11 

KCC714 

0.16 

50 

32 

0.32 

0.91 

-0.75 

0.84 

-0.73 

0.42 

1.30 

1 

12 

KCC71 

0.69 

47 

30 

0.33 

1.17 

1.24 

1.20 

0.88 

0.27 

0.56 

1 

13 

K0430 

-1.65 

18 

16 

0.89 

0.56 

-0.78 

0.24 

-0.33 

0.59 

1.37 

1 

14 

K0390 

-1.01 

19 

15 

0.68 

0.87 

-0.29 

0.62 

-0.01 

0.56 

1.22 

1 

15 

K0308 

-0.46 

17 

13 

0.64 

1.12 

0.50 

1.26 

0.58 

0.32 

0.73 

1 

16 

K0474 

0.25 

18 

14 

0.64 

0.68 

-0.94 

0.50 

-0.93 

0.69 

1.42 

1 

17 

K0372 

1.67 

17 

10 

0.58 

1.12 

0.63 

1.04 

0.43 

0.45 

0.62 

1 

18 

K0150 

-1.65 

18 

15 

0.77 

0.89 

-0.08 

0.58 

-0.02 

0.58 

1.12 

1 

19 

KOA215 

-0.68 

47 

40 

0.43 

0.89 

-0.35 

0.77 

-0.31 

0.38 

1.12 

1 

20 

31212 

-0.20 

22 

16 

0.53 

1.12 

0.51 

1.10 

0.37 

0.33 

0.83 

1 

21 

K0128 

0.26 

15 

9 

0.65 

0.90 

-0.33 

0.83 

0.03 

0.60 

1.23 

1 

22 

KOA118 

1.12 

47 

26 

0.33 

1.22 

1.80 

1.23 

1.22 

0.25 

0.32 

1 

23 

KNBT14 

0.59 

50 

28 

0.31 

0.92 

-0.66 

0.88 

-0.47 

0.47 

1.24 

1 

24 

KNBT129 

1.24 

48 

22 

0.32 

1.06 

0.55 

1.01 

0.14 

0.35 

0.84 

1 

25 

KNBT163 

2.56 

48 

16 

0.34 

0.91 

-0.62 

1.24 

1.02 

0.47 

1.12 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

K0545 

-2.21 

23 

22 

1.07 

1.20 

0.50 

1.35 

0.69 

0.10 

0.85 

2 

2 

30715 

-0.90 

104 

89 

0.30 

1.06 

0.40 

0.88 

-0.24 

0.26 

0.97 

2 

3 

30414 

0.29 

19 

13 

0.64 

1.47 

1.28 

1.30 

0.66 

0.46 

0.49 

2 

4 

31162 

0.58 

18 

13 

0.61 

1.08 

0.36 

1.08 

0.32 

0.44 

0.87 

2 

5 

KG515 

1.38 

52 

26 

0.30 

1.17 

1.56 

1.14 

0.98 

0.23 

0.44 

2 

6 

KG62 

1.76 

50 

16 

0.34 

1.00 

0.06 

1.03 

0.21 

0.43 

0.99 

2 

7 

KMD311 

-0.22 

51 

41 

0.37 

0.91 

-0.40 

0.67 

-0.92 

0.43 

1.17 

2 

8 

KCC511 

-2.02 

49 

46 

0.61 

0.91 

-0.03 

0.57 

-0.35 

0.31 

1.07 

2 

9 

KCC513 

-0.83 

51 

45 

0.46 

0.91 

-0.18 

1.00 

0.20 

0.35 

1.05 

2 

10 

KCC75 

-0.41 

52 

43 

0.38 

1.00 

0.08 

1.02 

0.17 

0.26 

0.99 

2 

11 

K0059 

0.17 

18 

13 

0.70 

0.99 

0.11 

0.85 

0.09 

0.63 

1.02 

2 

12 

KCC519 

0.80 

47 

29 

0.33 

1.20 

1.51 

1.18 

0.85 

0.26 

0.48 

2 

13 

K0353 

-1.63 

19 

17 

0.86 

0.66 

-0.48 

0.31 

-0.22 

0.54 

1.27 

2 

14 

K0489 

-1.00 

18 

16 

0.90 

0.64 

-0.48 

0.30 

-0.24 

0.61 

1.28 

2 

15 

K0441 

-0.41 

18 

14 

0.69 

0.77 

-0.59 

0.48 

-0.38 

0.64 

1.34 

2 

16 

K0469 

0.21 

18 

12 

0.55 

1.08 

0.45 

1.00 

0.13 

0.35 

0.83 

2 

17 

K0366 

1.69 

18 

9 

0.59 

0.71 

-1.12 

0.58 

-0.69 

0.65 

1.61 

2 

18 

K0151 

-1.67 

18 

16 

0.84 

0.65 

-0.71 

0.28 

-0.27 

0.54 

1.37 

2 

19 

KOOlO 

-0.68 

17 

14 

0.83 

0.65 

-0.70 

0.35 

-0.31 

0.69 

1.40 

2 

20 

K0075 

-0.32 

18 

14 

0.69 

1.10 

0.38 

1.17 

0.47 

0.50 

0.85 

2 

21 

K0057 

0.32 

18 

13 

0.60 

0.74 

-0.82 

0.61 

-0.80 

0.60 

1.42 

2 

22 

30601 

1.02 

16 

11 

0.62 

0.80 

-0.76 

0.66 

-0.57 

0.59 

1.49 

2 

23 

KNBT16 

0.54 

48 

29 

0.32 

1.06 

0.54 

1.09 

0.54 

0.32 

0.80 

2 

24 

KNBT159 

1.26 

48 

21 

0.31 

1.19 

1.82 

1.20 

1.51 

0.10 

0.22 

2 

25 

KNBT160 

2.42 

48 

12 

0.37 

1.10 

0.59 

1.20 

0.71 

0.31 

0.83 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

K0546 

-2.10 

16 

15 

1.08 

0.72 

-0.13 

0.30 

-0.23 

0.37 

1.24 

3 

2 

30706 

-0.90 

13 

9 

0.75 

1.14 

0.51 

0.86 

0.12 

0.56 

0.86 

3 

3 

30408 

0.34 

20 

13 

0.61 

0.84 

-0.54 

0.90 

-0.04 

0.64 

1.23 

3 

4 

30112 

0.50 

16 

10 

0.63 

0.91 

-0.29 

0.77 

-0.46 

0.60 

1.30 

3 

5 

31021 

1.29 

12 

6 

0.78 

1.25 

0.75 

1.50 

0.78 

0.56 

0.45 

3 

6 

KG337 

1.91 

51 

19 

0.33 

0.81 

-1.41 

0.75 

-1.13 

0.59 

1.42 

3 

7 

K0393 

0.20 

18 

12 

0.63 

1.06 

0.29 

0.78 

-0.15 

0.59 

1.00 

3 

8 

KCC64 

-2.05 

49 

46 

0.61 

1.03 

0.22 

0.63 

-0.22 

0.23 

1.02 

3 

9 

KCC23 

-0.83 

51 

45 

0.46 

0.98 

0.05 

0.59 

-0.61 

0.38 

1.08 

3 

10 

KCC112 

-0.39 

102 

83 

0.28 

0.87 

-0.81 

0.63 

-1.26 

0.49 

1.19 

3 

11 

KCC76 

0.17 

100 

64 

0.23 

0.92 

-0.86 

0.84 

-0.93 

0.44 

1.24 

3 

12 

KCC720 

0.80 

51 

30 

0.32 

1.00 

0.06 

0.95 

-0.15 

0.44 

1.01 

3 

13 

KMD19 

-1.48 

50 

44 

0.46 

0.78 

-0.64 

0.48 

-0.70 

0.48 

1.20 

3 

14 

K0368 

-0.99 

17 

14 

0.93 

0.34 

-1.16 

0.15 

-0.90 

0.83 

1.42 

3 

15 

K0313 

-0.44 

19 

15 

0.67 

0.98 

0.07 

0.91 

0.10 

0.52 

1.03 

3 

16 

K0473 

0.18 

20 

13 

0.54 

1.02 

0.17 

1.09 

0.38 

0.45 

0.93 

3 

17 

K0384 

1.70 

18 

8 

0.63 

1.01 

0.14 

0.94 

0.06 

0.66 

1.00 

3 

18 

KOI 44 

-1.70 

18 

14 

0.82 

0.99 

0.14 

0.71 

0.13 

0.69 

1.03 

3 

19 

K0155 

-0.69 

17 

15 

0.88 

0.82 

-0.12 

0.75 

0.08 

0.48 

1.12 

3 

20 

K0071 

-0.30 

20 

16 

0.64 

0.52 

-1.68 

0.34 

-1.08 

0.66 

1.61 

3 

21 

K0021 

0.32 

504 

346 

0.12 

0.90 

-1.92 

0.80 

-2.06 

0.58 

1.19 

3 

22 

KOI 74 

0.98 

18 

12 

0.63 

0.79 

-0.78 

0.57 

-0.56 

0.69 

1.46 

3 

23 

KNBT139 

0.65 

50 

27 

0.31 

0.88 

-1.19 

0.86 

-0.83 

0.47 

1.45 

3 

24 

KNBT115 

1.30 

99 

46 

0.23 

1.13 

1.52 

1.19 

1.17 

0.37 

0.61 

3 

25 

KNBT133 

2.27 

52 

21 

0.32 

1.00 

0.03 

1.00 

0.04 

0.45 

1.00 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

K0550 

-2.01 

18 

17 

1.09 

0.69 

-0.17 

0.19 

-0.43 

0.46 

1.23 

4 

2 

30251 

-0.91 

18 

15 

0.73 

0.71 

-0.58 

0.51 

-0.53 

0.55 

1.35 

4 

3 

K0516 

0.38 

17 

12 

0.63 

0.79 

-0.64 

0.59 

-0.67 

0.64 

1.37 

4 

4 

30412 

0.50 

23 

15 

0.61 

0.66 

-1.15 

0.44 

-1.01 

0.77 

1.48 

4 

5 

30418 

1.40 

9 

4 

0.80 

0.50 

-1.68 

0.45 

-1.47 

0.66 

2.14 

4 

6 

KG320 

1.61 

51 

25 

0.31 

0.98 

-0.11 

0.95 

-0.21 

0.44 

1.06 

4 

7 

KMD310 

-0.05 

47 

36 

0.37 

1.00 

0.09 

1.16 

0.54 

0.32 

0.95 

4 

8 

KCC322 

-1.99 

50 

47 

0.61 

0.96 

0.08 

0.51 

-0.45 

0.28 

1.07 

4 

9 

K0093 

-0.89 

18 

14 

0.70 

0.63 

-1.01 

0.38 

-0.23 

0.68 

1.43 

4 

10 

K0127 

-0.40 

18 

14 

0.68 

0.67 

-0.80 

0.45 

-0.64 

0.69 

1.38 

4 

11 

KCC715 

0.19 

50 

32 

0.32 

0.81 

-1.53 

0.70 

-1.12 

0.56 

1.50 

4 

12 

KCC722 

0.68 

52 

37 

0.34 

0.94 

-0.35 

0.86 

-0.46 

0.44 

1.13 

4 

13 

K0350 

-1.48 

17 

12 

0.67 

1.01 

0.16 

0.76 

-0.16 

0.62 

1.05 

4 

14 

KMDllO 

-1.00 

48 

41 

0.43 

0.83 

-0.55 

0.61 

-0.81 

0.47 

1.18 

4 

15 

K0420 

-0.40 

18 

14 

0.70 

0.98 

0.06 

0.74 

-0.20 

0.57 

1.10 

4 

16 

K0354 

0.31 

18 

11 

0.65 

0.96 

-0.02 

0.69 

-0.30 

0.68 

1.13 

4 

17 

K0451 

1.86 

19 

8 

0.56 

1.23 

0.97 

1.10 

0.39 

0.45 

0.56 

4 

18 

K0003 

-1.74 

18 

17 

1.10 

0.88 

0.11 

0.27 

-0.27 

0.39 

1.15 

4 

19 

K0083 

-0.72 

18 

14 

0.72 

0.94 

-0.06 

0.60 

-0.25 

0.61 

1.17 

4 

20 

K0028 

-0.29 

18 

15 

0.76 

1.11 

0.40 

0.69 

-0.18 

0.49 

1.00 

4 

21 

K0061 

0.33 

18 

13 

0.62 

0.70 

-1.16 

0.54 

-0.95 

0.64 

1.60 

4 

22 

K0048 

0.99 

19 

10 

0.51 

1.00 

0.08 

0.95 

-0.06 

0.45 

1.02 

4 

23 

KNBT135 

0.58 

47 

31 

0.34 

0.90 

-0.68 

0.84 

-0.58 

0.47 

1.24 

4 

24 

KNBT165 

1.38 

48 

21 

0.32 

1.07 

0.59 

1.02 

0.17 

0.37 

0.85 

4 

25 

KNBTlll 

2.26 

49 

17 

0.36 

1.20 

1.09 

1.04 

0.23 

0.46 

0.76 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

K0536 

-1.97 

113 

105 

0.41 

1.24 

0.82 

1.24 

0.57 

0.24 

0.90 

5 

2 

30256 

-0.92 

14 

11 

0.76 

1.03 

0.21 

0.90 

0.10 

0.48 

0.99 

5 

3 

K0505 

0.29 

18 

11 

0.55 

0.55 

-2.17 

0.45 

-1.59 

0.79 

1.91 

5 

4 

K0528 

0.58 

18 

12 

0.56 

1.05 

0.29 

0.99 

0.06 

0.39 

0.91 

5 

5 

30102 

1.23 

18 

10 

0.62 

0.83 

-0.48 

0.68 

-0.51 

0.68 

1.29 

5 

6 

31208 

1.93 

21 

8 

0.53 

1.19 

0.85 

1.15 

0.59 

0.38 

0.63 

5 

7 

KMD317 

-0.20 

49 

38 

0.38 

0.89 

-0.52 

0.79 

-0.33 

0.43 

1.16 

5 

8 

K0024 

-1.87 

117 

108 

0.38 

0.91 

-0.22 

0.52 

-0.94 

0.41 

1.09 

5 

9 

KCC59 

-0.83 

51 

45 

0.46 

0.83 

-0.47 

0.64 

-0.49 

0.45 

1.14 

5 

10 

KCC711 

-0.44 

48 

39 

0.41 

0.98 

-0.02 

0.69 

-0.51 

0.43 

1.08 

5 

11 

K0062 

0.22 

19 

13 

0.60 

0.67 

-1.31 

0.57 

-1.05 

0.67 

1.62 

5 

12 

KCC310 

0.58 

55 

40 

0.33 

1.09 

0.65 

1.22 

0.83 

0.29 

0.80 

5 

13 

K0391 

-1.43 

19 

17 

0.92 

0.55 

-0.57 

0.21 

-0.38 

0.66 

1.30 

5 

14 

K0462 

-1.00 

18 

15 

0.72 

0.48 

-1.54 

0.26 

-0.55 

0.65 

1.56 

5 

15 

K0348 

-0.36 

18 

14 

0.69 

0.55 

-1.31 

0.35 

-0.86 

0.72 

1.54 

5 

16 

K0315 

0.30 

18 

13 

0.61 

1.45 

1.68 

1.29 

0.68 

0.30 

0.13 

5 

17 

K0378 

1.82 

18 

9 

0.59 

1.28 

1.11 

1.33 

0.97 

0.45 

0.35 

5 

18 

KOI 62 

-1.74 

18 

17 

1.12 

0.49 

-0.50 

0.15 

-0.53 

0.49 

1.31 

5 

19 

K0084 

-0.79 

17 

13 

0.77 

0.87 

-0.13 

0.53 

-0.27 

0.69 

1.19 

5 

20 

K0038 

-0.29 

19 

15 

0.71 

1.10 

0.38 

1.04 

0.31 

0.55 

0.88 

5 

21 

KOI 02 

0.33 

18 

12 

0.67 

1.09 

0.36 

1.10 

0.36 

0.61 

0.89 

5 

22 

KOA41 

0.96 

100 

54 

0.22 

1.12 

1.56 

1.08 

0.61 

0.33 

0.62 

5 

23 

KNBT146 

0.38 

48 

31 

0.33 

0.94 

-0.42 

0.90 

-0.48 

0.41 

1.17 

5 

24 

KNBT113 

1.34 

48 

21 

0.32 

1.05 

0.44 

1.11 

0.70 

0.33 

0.81 

5 

25 

KNBT131 

2.13 

51 

17 

0.33 

1.01 

0.14 

0.98 

-0.01 

0.43 

0.98 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

K0535 

-1.95 

18 

16 

1.08 

0.91 

0.15 

0.36 

-0.14 

0.66 

1.12 

6 

2 

KG21 

-0.97 

48 

41 

0.43 

1.06 

0.30 

0.94 

0.01 

0.25 

0.97 

6 

3 

KG330 

0.29 

50 

31 

0.32 

1.04 

0.39 

0.95 

-0.13 

0.38 

0.94 

6 

4 

KG539 

0.50 

51 

36 

0.34 

0.90 

-0.58 

0.79 

-0.73 

0.49 

1.21 

6 

5 

30558 

1.46 

19 

8 

0.53 

0.91 

-0.43 

0.74 

0.06 

0.50 

1.32 

6 

6 

30560 

2.00 

16 

7 

0.67 

0.69 

-1.03 

0.50 

-0.76 

0.77 

1.53 

6 

7 

KMD313 

0.19 

49 

37 

0.35 

0.92 

-0.43 

0.81 

-0.47 

0.38 

1.16 

6 

8 

KOI 70 

-1.76 

116 

108 

0.38 

0.93 

-0.14 

0.63 

-0.57 

0.27 

1.06 

6 

9 

KCC317 

-0.84 

51 

45 

0.46 

1.02 

0.16 

1.26 

0.60 

0.20 

0.95 

6 

10 

KCC54 

-0.35 

49 

39 

0.39 

0.85 

-0.69 

0.70 

-0.50 

0.45 

1.20 

6 

11 

KCC74 

0.22 

47 

34 

0.35 

0.96 

-0.18 

0.85 

-0.41 

0.41 

1.11 

6 

12 

KCC121 

0.56 

49 

30 

0.33 

1.11 

0.82 

1.04 

0.28 

0.36 

0.78 

6 

13 

K0405 

-1.43 

19 

16 

0.76 

0.68 

-0.64 

0.35 

-0.32 

0.60 

1.34 

6 

14 

KMD22 

-0.98 

48 

41 

0.42 

1.05 

0.27 

0.87 

-0.21 

0.23 

0.99 

6 

15 

K0496 

-0.35 

19 

14 

0.73 

0.80 

-0.37 

0.53 

-0.31 

0.71 

1.26 

6 

16 

K0491 

0.33 

18 

13 

0.71 

0.57 

-1.23 

0.39 

-0.90 

0.76 

1.56 

6 

17 

K0325 

2.01 

18 

8 

0.59 

0.91 

-0.32 

0.95 

0.09 

0.60 

1.15 

6 

18 

KOI 54 

-1.85 

18 

15 

0.85 

0.62 

-0.69 

0.28 

-0.26 

0.72 

1.36 

6 

19 

KOI 08 

-0.80 

18 

15 

0.68 

1.12 

0.43 

0.95 

0.18 

0.27 

0.90 

6 

20 

KOI 67 

-0.27 

18 

13 

0.70 

0.77 

-0.50 

0.54 

-0.49 

0.70 

1.32 

6 

21 

K0016 

0.34 

19 

14 

0.61 

1.49 

1.51 

1.44 

0.92 

0.26 

0.31 

6 

22 

30011 

0.98 

11 

5 

0.65 

1.16 

0.75 

1.10 

0.45 

0.20 

0.48 

6 

23 

KNBT156 

0.43 

49 

29 

0.31 

1.17 

1.60 

1.12 

0.70 

0.23 

0.40 

6 

24 

KNBT164 

1.40 

52 

30 

0.31 

0.91 

-0.82 

0.83 

-0.89 

0.50 

1.31 

6 

25 

KNBT157 

1.93 

50 

15 

0.34 

0.97 

-0.15 

1.13 

0.54 

0.42 

0.99 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

30254 

-1.95 

17 

16 

1.06 

0.99 

0.27 

0.52 

0.06 

0.25 

1.05 

7 

2 

30725 

-0.97 

115 

100 

0.31 

0.94 

-0.21 

0.75 

-0.54 

0.44 

1.07 

7 

3 

30511 

0.32 

125 

93 

0.23 

1.08 

0.74 

0.99 

0.04 

0.37 

0.90 

7 

4 

31210 

0.58 

13 

9 

0.73 

0.76 

-0.76 

0.58 

-0.52 

0.67 

1.50 

7 

5 

31160 

1.26 

20 

11 

0.54 

1.24 

0.92 

1.32 

0.93 

0.40 

0.58 

7 

6 

30704 

1.67 

16 

8 

0.62 

0.74 

-1.00 

0.55 

-0.89 

0.72 

1.54 

7 

7 

KMD328 

0.15 

48 

35 

0.37 

0.94 

-0.32 

0.86 

-0.28 

0.49 

1.10 

7 

8 

KCC313 

-1.78 

98 

91 

0.41 

0.89 

-0.25 

0.57 

-0.71 

0.30 

1.09 

7 

9 

KCClll 

-0.91 

51 

42 

0.39 

1.00 

0.08 

0.91 

-0.09 

0.26 

1.01 

7 

10 

KOI 86 

-0.38 

122 

97 

0.25 

0.77 

-1.75 

0.68 

-1.12 

0.57 

1.27 

7 

11 

K0039 

0.26 

16 

11 

0.61 

0.81 

-0.79 

0.77 

-0.83 

0.52 

1.59 

7 

12 

K0449 

0.55 

19 

9 

0.58 

1.12 

0.49 

1.05 

0.25 

0.54 

0.84 

7 

13 

K0458 

-1.43 

16 

15 

1.13 

1.36 

0.68 

1.13 

0.56 

0.18 

0.75 

7 

14 

K0307 

-0.92 

18 

16 

0.84 

0.97 

0.11 

0.54 

-0.30 

0.42 

1.13 

7 

15 

K0419 

-0.37 

19 

16 

0.67 

1.03 

0.21 

0.80 

-0.11 

0.30 

1.02 

7 

16 

K0480 

0.31 

19 

12 

0.56 

0.85 

-0.49 

0.73 

-0.63 

0.63 

1.28 

7 

17 

K0332 

1.89 

17 

8 

0.55 

1.06 

0.33 

1.02 

0.16 

0.43 

0.88 

7 

18 

K0148 

-1.98 

19 

18 

1.08 

0.65 

-0.22 

0.21 

-0.39 

0.40 

1.25 

7 

19 

K0097 

-0.82 

18 

15 

0.79 

1.00 

0.16 

0.58 

-0.10 

0.58 

1.07 

7 

20 

KOI 85 

-0.26 

17 

14 

0.69 

1.05 

0.25 

0.72 

-0.20 

0.37 

1.03 

7 

21 

K0074 

0.35 

19 

13 

0.64 

0.94 

-0.17 

0.77 

-0.19 

0.64 

1.19 

7 

22 

K0067 

1.00 

19 

9 

0.60 

1.34 

1.10 

1.10 

0.36 

0.51 

0.60 

7 

23 

KNBT15 

0.76 

48 

33 

0.34 

1.00 

0.05 

0.92 

-0.30 

0.40 

1.03 

7 

24 

KNBT132 

1.41 

48 

27 

0.32 

1.08 

0.69 

1.17 

1.01 

0.33 

0.70 

7 

25 

KNBT130 

1.90 

51 

22 

0.31 

1.29 

2.28 

1.45 

2.22 

0.15 

0.10 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

30274 

-1.93 

114 

106 

0.38 

0.86 

-0.42 

0.72 

-0.41 

0.33 

1.10 

8 

2 

30703 

-1.03 

15 

12 

0.75 

0.64 

-0.91 

0.39 

-0.61 

0.64 

1.46 

8 

3 

30702 

0.40 

16 

10 

0.65 

1.06 

0.32 

1.00 

0.16 

0.57 

0.85 

8 

4 

KG51 

0.50 

51 

36 

0.34 

1.09 

0.60 

1.06 

0.31 

0.32 

0.85 

8 

5 

KG57 

1.38 

52 

26 

0.30 

1.23 

2.08 

1.33 

2.14 

0.14 

0.13 

8 

6 

30554 

1.69 

19 

10 

0.53 

0.86 

-0.59 

0.85 

-0.48 

0.59 

1.33 

8 

7 

KMD314 

-0.27 

50 

36 

0.34 

0.73 

-1.95 

0.61 

-1.55 

0.53 

1.58 

8 

8 

KCC42 

-1.66 

50 

47 

0.61 

0.93 

0.01 

0.89 

0.16 

0.23 

1.04 

8 

9 

KCC710 

-0.92 

52 

46 

0.45 

0.95 

-0.05 

0.64 

-0.62 

0.33 

1.08 

8 

10 

KCC312 

-0.39 

49 

38 

0.37 

1.15 

0.84 

1.14 

0.51 

0.24 

0.79 

8 

11 

KOI 45 

0.26 

18 

13 

0.58 

1.15 

0.59 

1.21 

0.58 

0.28 

0.74 

8 

12 

KCC114 

0.49 

51 

34 

0.34 

1.08 

0.61 

0.95 

-0.06 

0.40 

0.87 

8 

13 

K0463 

-1.39 

18 

16 

0.88 

0.61 

-0.53 

0.29 

-0.29 

0.60 

1.29 

8 

14 

K0443 

-0.92 

18 

14 

0.75 

0.50 

-1.36 

0.28 

-0.46 

0.76 

1.53 

8 

15 

K0396 

-0.40 

18 

13 

0.67 

0.62 

-1.38 

0.42 

-0.61 

0.71 

1.63 

8 

16 

K0387 

0.27 

19 

13 

0.60 

1.02 

0.15 

0.84 

-0.16 

0.55 

1.03 

8 

17 

KMD26 

1.80 

51 

20 

0.32 

1.19 

1.41 

1.20 

0.95 

0.30 

0.56 

8 

18 

KOI 64 

-1.96 

18 

17 

1.06 

0.96 

0.23 

0.53 

0.06 

0.26 

1.07 

8 

19 

K0161 

-0.83 

18 

16 

0.88 

0.79 

-0.15 

0.69 

-0.09 

0.50 

1.15 

8 

20 

K0037 

-0.25 

503 

385 

0.13 

0.93 

-1.17 

0.72 

-2.20 

0.55 

1.14 

8 

21 

KOI 34 

0.36 

18 

13 

0.60 

0.79 

-0.61 

0.76 

-0.37 

0.58 

1.30 

8 

22 

K0025 

1.03 

19 

12 

0.59 

1.01 

0.12 

0.80 

-0.24 

0.59 

1.06 

8 

23 

KNBT138 

0.31 

49 

36 

0.35 

1.01 

0.10 

0.98 

0.05 

0.32 

0.98 

8 

24 

KNBT153 

1.44 

51 

25 

0.30 

0.93 

-0.61 

0.91 

-0.59 

0.46 

1.24 

8 

25 

KNBT197 

2.60 

48 

14 

0.36 

0.82 

-0.97 

0.74 

-1.01 

0.60 

1.28 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

K0538 

-1.89 

17 

16 

1.08 

0.89 

0.13 

0.34 

-0.17 

0.36 

1.13 

9 

2 

KG517 

-1.00 

100 

83 

0.28 

0.84 

-0.94 

0.69 

-0.90 

0.42 

1.18 

9 

3 

K0522 

0.35 

18 

12 

0.55 

0.99 

0.03 

0.86 

-0.27 

0.41 

1.10 

9 

4 

KG528 

0.57 

52 

38 

0.34 

1.01 

0.09 

0.94 

-0.12 

0.37 

1.00 

9 

5 

KG526 

1.20 

48 

29 

0.32 

0.95 

-0.34 

1.00 

0.08 

0.43 

1.08 

9 

6 

31018 

2.04 

19 

5 

0.62 

1.22 

0.80 

1.36 

0.66 

0.38 

0.62 

9 

7 

KMD319 

0.11 

48 

33 

0.34 

0.89 

-0.76 

0.83 

-0.68 

0.48 

1.26 

9 

8 

KOI 52 

-1.69 

116 

108 

0.38 

0.89 

-0.29 

0.43 

-1.00 

0.34 

1.11 

9 

9 

KCC318 

-0.91 

50 

41 

0.39 

0.99 

0.03 

1.01 

0.16 

0.25 

0.99 

9 

10 

KCC320 

-0.37 

50 

38 

0.35 

0.93 

-0.36 

0.89 

-0.35 

0.40 

1.11 

9 

11 

KCC713 

0.35 

50 

36 

0.34 

1.03 

0.23 

0.93 

-0.14 

0.34 

0.98 

9 

12 

KCC719 

0.49 

48 

30 

0.33 

0.93 

-0.48 

0.90 

-0.56 

0.42 

1.20 

9 

13 

K0369 

-1.38 

19 

16 

0.73 

0.56 

-1.14 

0.30 

-0.42 

0.62 

1.48 

9 

14 

KMDlll 

-0.97 

48 

41 

0.43 

0.98 

0.00 

1.01 

0.17 

0.29 

1.01 

9 

15 

30289 

-0.42 

501 

395 

0.13 

1.08 

1.10 

1.06 

0.43 

0.46 

0.91 

9 

16 

K0486 

0.25 

17 

12 

0.66 

0.81 

-0.52 

0.82 

-0.14 

0.61 

1.26 

9 

17 

K0445 

1.50 

17 

7 

0.58 

1.12 

0.57 

1.11 

0.38 

0.45 

0.72 

9 

18 

K0115 

-1.91 

18 

17 

1.06 

0.71 

-0.10 

0.23 

-0.34 

0.42 

1.21 

9 

19 

K0080 

-0.83 

17 

15 

0.83 

0.65 

-0.59 

0.37 

-0.39 

0.52 

1.33 

9 

20 

KOI 14 

-0.25 

18 

14 

0.64 

1.06 

0.32 

0.78 

-0.01 

0.42 

0.97 

9 

21 

K0123 

0.37 

18 

13 

0.61 

0.87 

-0.59 

0.81 

-0.14 

0.53 

1.38 

9 

22 

KOI 73 

1.06 

19 

11 

0.62 

1.09 

0.43 

1.01 

0.16 

0.63 

0.85 

9 

23 

KNBT141 

0.30 

48 

31 

0.32 

0.99 

-0.01 

0.91 

-0.52 

0.35 

1.08 

9 

24 

KNBT119 

1.50 

52 

29 

0.31 

0.98 

-0.12 

1.15 

0.85 

0.42 

0.97 

9 

25 

KNBTll 

1.77 

49 

22 

0.32 

1.14 

1.20 

1.32 

1.74 

0.29 

0.43 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

30403 

-1.89 

18 

15 

0.84 

0.77 

-0.33 

0.43 

-0.04 

0.63 

1.24 

10 

2 

30266 

-1.01 

18 

15 

0.70 

0.88 

-0.20 

1.21 

0.52 

0.40 

1.02 

10 

3 

KG321 

0.39 

51 

34 

0.33 

1.00 

0.06 

0.98 

0.01 

0.42 

1.00 

10 

4 

30716 

0.53 

14 

10 

0.69 

1.09 

0.37 

0.83 

-0.05 

0.47 

0.95 

10 

5 

31025 

1.37 

21 

9 

0.54 

1.15 

0.71 

1.06 

0.30 

0.49 

0.71 

10 

6 

31012 

1.88 

17 

8 

0.60 

1.27 

1.11 

1.25 

0.66 

0.46 

0.39 

10 

7 

K0382 

-0.20 

19 

14 

0.69 

1.39 

1.26 

1.20 

0.51 

0.55 

0.36 

10 

8 

K0013 

-1.62 

18 

15 

0.88 

0.49 

-0.93 

0.21 

-0.39 

0.76 

1.40 

10 

9 

KOI 82 

-0.92 

18 

15 

0.73 

0.75 

-0.49 

0.48 

-0.64 

0.55 

1.30 

10 

10 

KCC321 

-0.38 

49 

38 

0.37 

1.09 

0.52 

1.10 

0.42 

0.25 

0.87 

10 

11 

KCC24 

0.37 

52 

35 

0.33 

1.23 

1.51 

1.21 

0.82 

0.25 

0.56 

10 

12 

K0423 

0.46 

121 

81 

0.22 

0.90 

-0.98 

0.97 

-0.14 

0.51 

1.15 

10 

13 

K0352 

-1.35 

18 

16 

0.79 

0.74 

-0.36 

0.37 

-0.32 

0.50 

1.25 

10 

14 

K0386 

-0.95 

116 

101 

0.30 

1.09 

0.54 

1.17 

0.51 

0.26 

0.90 

10 

15 

K0427 

-0.44 

18 

15 

0.67 

0.84 

-0.33 

0.64 

-0.18 

0.41 

1.21 

10 

16 

K0329 

0.34 

19 

13 

0.56 

1.18 

0.82 

1.10 

0.36 

0.34 

0.67 

10 

17 

K0444 

1.48 

18 

9 

0.60 

1.27 

1.07 

1.18 

0.51 

0.51 

0.44 

10 

18 

KOI 06 

-1.88 

17 

16 

1.07 

0.94 

0.19 

0.44 

-0.04 

0.29 

1.09 

10 

19 

K0178 

-0.84 

18 

15 

0.83 

0.97 

0.10 

0.44 

-0.11 

0.65 

1.12 

10 

20 

K0113 

-0.24 

20 

15 

0.63 

0.92 

-0.16 

0.70 

-0.12 

0.58 

1.14 

10 

21 

KOlOl 

0.38 

17 

10 

0.64 

0.77 

-0.78 

0.63 

-0.76 

0.68 

1.46 

10 

22 

KOI 76 

1.09 

18 

8 

0.55 

0.91 

-0.36 

1.08 

0.35 

0.51 

1.13 

10 

23 

KNBT117 

0.70 

51 

31 

0.32 

1.09 

0.70 

1.00 

0.07 

0.38 

0.83 

10 

24 

KNBT126 

1.49 

50 

19 

0.32 

1.12 

0.98 

1.23 

1.01 

0.31 

0.63 

10 

25 

KNBT171 

1.76 

100 

44 

0.23 

1.30 

3.22 

1.44 

2.56 

0.21 

0.13 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

K0397 

-1.87 

18 

16 

1.05 

1.03 

0.32 

0.79 

0.31 

0.55 

0.99 

BMF 

2 

KG322 

-1.02 

49 

44 

0.52 

0.85 

-0.29 

0.52 

-0.68 

0.49 

1.13 

BMF 

3 

KG31 

0.32 

52 

40 

0.36 

1.01 

0.13 

0.97 

0.03 

0.36 

1.00 

BMF 

4 

KG530 

0.54 

52 

35 

0.32 

0.88 

-1.00 

0.81 

-0.89 

0.48 

1.33 

BMF 

5 

KG332 

1.32 

49 

25 

0.33 

1.12 

1.01 

1.06 

0.33 

0.43 

0.70 

BMF 

6 

KG335 

1.61 

48 

19 

0.32 

1.06 

0.52 

1.17 

0.97 

0.34 

0.79 

BMF 

7 

KMD325 

-0.26 

49 

37 

0.36 

1.01 

0.12 

1.11 

0.43 

0.34 

0.93 

BMF 

8 

KCC510 

-1.51 

50 

45 

0.49 

1.04 

0.23 

0.80 

-0.24 

0.24 

1.00 

BMF 

9 

KCC22 

-0.79 

50 

42 

0.41 

0.76 

-0.97 

0.80 

-0.35 

0.46 

1.22 

BMF 

10 

KCC716 

-0.51 

49 

40 

0.40 

0.85 

-0.63 

0.63 

-0.59 

0.45 

1.21 

BMF 

11 

KCC15 

0.10 

51 

39 

0.36 

1.07 

0.42 

1.04 

0.23 

0.28 

0.89 

BMF 

12 

KCC319 

0.51 

52 

30 

0.31 

1.08 

0.68 

1.18 

0.80 

0.36 

0.72 

BMF 

13 

K0375 

-1.34 

19 

16 

0.71 

0.82 

-0.38 

0.54 

-0.03 

0.47 

1.25 

BMF 

14 

K0481 

-1.06 

19 

16 

0.68 

0.78 

-0.51 

0.48 

-0.28 

0.46 

1.29 

BMF 

15 

K0498 

-0.35 

18 

15 

0.68 

0.81 

-0.38 

0.68 

-0.30 

0.43 

1.22 

BMF 

16 

K0376 

0.22 

18 

13 

0.64 

0.75 

-0.82 

0.53 

-0.66 

0.66 

1.42 

BMF 

17 

K0328 

1.60 

19 

8 

0.63 

0.79 

-0.61 

0.89 

0.00 

0.72 

1.25 

BMF 

18 

K0087 

-1.64 

18 

17 

1.09 

1.01 

0.28 

0.41 

-0.08 

0.32 

1.07 

BMF 

19 

K0126 

-0.68 

19 

16 

0.68 

0.89 

-0.16 

0.90 

0.16 

0.36 

1.09 

BMF 

20 

KOI 63 

-0.24 

18 

15 

0.77 

1.13 

0.42 

0.71 

-0.06 

0.50 

0.97 

BMF 

21 

K0136 

0.29 

18 

13 

0.59 

0.87 

-0.45 

0.72 

-0.41 

0.50 

1.32 

BMF 

22 

K0020 

1.13 

17 

10 

0.56 

0.76 

-1.21 

0.67 

-0.71 

0.61 

1.71 

BMF 

23 

KNBT154 

0.66 

48 

31 

0.35 

0.88 

-0.73 

0.86 

-0.43 

0.56 

1.21 

BMF 

24 

KNBTllOO 

1.19 

50 

22 

0.32 

0.98 

-0.15 

1.21 

1.03 

0.42 

0.98 

BMF 

25 

KNBT114 

2.70 

48 

10 

0.39 

1.14 

0.68 

1.17 

0.55 

0.29 

0.82 

BMF 

26 

10083 

-1.32 

24 

21 

0.66 

1.13 

0.44 

1.27 

0.58 

0.21 

0.85 

BMF 

27 

1MD226 

-0.73 

155 

137 

0.26 

1.04 

0.25 

0.99 

0.08 

0.23 

0.97 

BMF 

28 

1NBT58 

-0.18 

80 

65 

0.31 

0.81 

-1.08 

0.60 

-1.25 

0.52 

1.24 

BMF 

29 

1NBT528 

1.19 

70 

43 

0.28 

1.05 

0.46 

1.11 

0.64 

0.40 

0.85 

BMF 

30 

1MD231 

1.69 

80 

39 

0.25 

0.96 

-0.45 

0.93 

-0.42 

0.48 

1.13 


Note. BMF = Benchmark Fall. 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

30127 

-2.17 

19 

18 

1.07 

0.89 

0.13 

0.35 

-0.16 

0.32 

1.12 

BMW 

2 

KG322 

-1.02 

49 

44 

0.52 

0.85 

-0.29 

0.52 

-0.68 

0.49 

1.13 

BMW 

3 

KG31 

0.32 

52 

40 

0.36 

1.01 

0.13 

0.97 

0.03 

0.36 

1.00 

BMW 

4 

KG530 

0.54 

52 

35 

0.32 

0.88 

-1.00 

0.81 

-0.89 

0.48 

1.33 

BMW 

5 

KG37 

1.33 

50 

20 

0.32 

1.13 

1.09 

1.16 

0.94 

0.31 

0.62 

BMW 

6 

KG340 

1.70 

49 

19 

0.33 

1.07 

0.56 

1.10 

0.57 

0.39 

0.82 

BMW 

7 

KMD342 

-0.28 

48 

38 

0.39 

0.92 

-0.36 

1.09 

0.34 

0.44 

1.06 

BMW 

8 

K0158 

-1.55 

17 

16 

1.06 

1.07 

0.36 

0.77 

0.29 

0.19 

0.97 

BMW 

9 

KCC58 

-0.79 

48 

40 

0.41 

0.90 

-0.34 

0.97 

0.07 

0.35 

1.09 

BMW 

10 

KCC38 

-0.50 

47 

39 

0.41 

0.98 

-0.02 

1.05 

0.26 

0.31 

1.00 

BMW 

11 

KCC44 

0.11 

51 

33 

0.32 

0.97 

-0.15 

0.88 

-0.35 

0.44 

1.10 

BMW 

12 

KCC13 

0.54 

53 

36 

0.32 

0.95 

-0.38 

0.93 

-0.27 

0.40 

1.13 

BMW 

13 

KMD21 

-1.31 

49 

44 

0.50 

0.92 

-0.12 

0.83 

0.07 

0.31 

1.05 

BMW 

14 

K0422 

-1.06 

18 

15 

0.90 

1.51 

0.91 

0.69 

0.14 

0.61 

0.83 

BMW 

15 

K0498 

-0.35 

18 

15 

0.68 

0.81 

-0.38 

0.68 

-0.30 

0.43 

1.22 

BMW 

16 

K0334 

0.22 

19 

13 

0.60 

0.81 

-0.67 

0.65 

-0.44 

0.62 

1.36 

BMW 

17 

K0323 

1.61 

18 

8 

0.59 

1.06 

0.31 

1.18 

0.53 

0.56 

0.83 

BMW 

18 

K0052 

-1.64 

17 

15 

0.84 

1.21 

0.55 

0.72 

0.18 

0.32 

0.93 

BMW 

19 

K0120 

-0.67 

17 

15 

0.78 

0.96 

0.10 

0.84 

0.15 

0.28 

1.04 

BMW 

20 

KOBO 

-0.24 

120 

87 

0.23 

1.26 

2.34 

1.25 

1.04 

0.24 

0.55 

BMW 

21 

K0136 

0.29 

18 

13 

0.59 

0.87 

-0.45 

0.72 

-0.41 

0.50 

1.32 

BMW 

22 

KOA113 

1.11 

50 

30 

0.32 

1.10 

0.85 

1.24 

1.18 

0.30 

0.66 

BMW 

23 

KNBT140 

0.67 

49 

31 

0.34 

0.91 

-0.71 

0.81 

-0.61 

0.50 

1.26 

BMW 

24 

KNBT158 

1.21 

49 

26 

0.33 

0.92 

-0.62 

0.88 

-0.44 

0.53 

1.21 

BMW 

25 

KOA514 

2.64 

99 

26 

0.25 

0.93 

-0.47 

1.20 

1.01 

0.43 

1.02 

BMW 

26 

10003 

-1.31 

24 

20 

0.63 

0.90 

-0.16 

0.55 

-0.20 

0.51 

1.15 

BMW 

27 

IMDlll 

-0.72 

72 

65 

0.41 

0.91 

-0.20 

0.92 

0.02 

0.28 

1.06 

BMW 

28 

10A413 

-0.18 

146 

118 

0.23 

0.95 

-0.32 

0.77 

-0.90 

0.44 

1.09 

BMW 

29 

1NBT522 

1.20 

86 

47 

0.24 

0.88 

-1.35 

0.96 

-0.22 

0.52 

1.30 

BMW 

30 

1MD217 

1.54 

95 

53 

0.23 

1.10 

1.17 

1.08 

0.59 

0.34 

0.72 


Note. BMW = Benchmark Winter. 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

30260 

-1.87 

14 

13 

1.14 

1.45 

0.76 

1.32 

0.68 

0.11 

0.73 

BMS 

2 

KOI 05 

-0.99 

17 

15 

0.83 

0.64 

-0.63 

0.31 

-0.39 

0.56 

1.33 

BMS 

3 

30116 

0.34 

12 

7 

0.68 

0.81 

-0.71 

0.69 

-0.62 

0.63 

1.57 

BMS 

4 

30579 

0.54 

22 

15 

0.55 

0.65 

-1.48 

0.53 

-1.09 

0.68 

1.61 

BMS 

5 

KG37 

1.33 

50 

20 

0.32 

1.13 

1.09 

1.16 

0.94 

0.31 

0.62 

BMS 

6 

KG340 

1.70 

49 

19 

0.33 

1.07 

0.56 

1.10 

0.57 

0.39 

0.82 

BMS 

7 

KMD342 

-0.28 

48 

38 

0.39 

0.92 

-0.36 

1.09 

0.34 

0.44 

1.06 

BMS 

8 

K0026 

-1.57 

120 

112 

0.39 

0.98 

0.04 

0.62 

-0.56 

0.32 

1.04 

BMS 

9 

KCC14 

-0.80 

48 

41 

0.44 

1.12 

0.51 

0.80 

-0.13 

0.31 

0.94 

BMS 

10 

KCC38 

-0.50 

47 

39 

0.41 

0.98 

-0.02 

1.05 

0.26 

0.31 

1.00 

BMS 

11 

KCC21 

0.11 

49 

34 

0.34 

0.92 

-0.55 

0.83 

-0.69 

0.46 

1.21 

BMS 

12 

KCC116 

0.54 

49 

30 

0.32 

1.05 

0.48 

1.07 

0.46 

0.34 

0.83 

BMS 

13 

KMD21 

-1.31 

49 

44 

0.50 

0.92 

-0.12 

0.83 

0.07 

0.31 

1.05 

BMS 

14 

K0362 

-1.04 

17 

13 

0.77 

0.44 

-1.46 

0.25 

-0.69 

0.78 

1.56 

BMS 

15 

K0421 

-0.34 

18 

12 

0.65 

1.26 

0.90 

1.43 

0.75 

0.52 

0.57 

BMS 

16 

K0483 

0.22 

18 

14 

0.64 

0.89 

-0.24 

0.86 

0.00 

0.49 

1.13 

BMS 

17 

K0418 

1.63 

16 

7 

0.66 

0.96 

-0.05 

0.85 

0.09 

0.64 

1.09 

BMS 

18 

K0191 

-1.60 

19 

18 

1.07 

0.83 

0.06 

0.29 

-0.25 

0.38 

1.15 

BMS 

19 

K0092 

-0.67 

18 

15 

0.69 

1.11 

0.40 

1.03 

0.30 

0.29 

0.87 

BMS 

20 

K0022 

-0.24 

18 

14 

0.65 

0.95 

-0.07 

1.41 

0.71 

0.42 

0.90 

BMS 

21 

KOI 68 

0.32 

18 

13 

0.63 

0.67 

-1.01 

0.49 

-0.85 

0.71 

1.46 

BMS 

22 

30603 

1.04 

16 

10 

0.66 

1.25 

0.90 

1.19 

0.59 

0.53 

0.50 

BMS 

23 

KNBT198 

0.67 

48 

26 

0.32 

0.98 

-0.19 

0.95 

-0.24 

0.39 

1.10 

BMS 

24 

KNBT127 

1.21 

49 

26 

0.33 

1.03 

0.31 

1.23 

0.98 

0.45 

0.82 

BMS 

25 

KNBT134 

1.81 

48 

17 

0.33 

1.04 

0.35 

1.03 

0.20 

0.37 

0.91 

BMS 

26 

10211 

-1.31 

21 

18 

0.68 

1.22 

0.62 

0.84 

0.12 

0.28 

0.89 

BMS 

27 

1MD215 

-0.70 

71 

63 

0.40 

0.75 

-0.93 

0.40 

-1.27 

0.50 

1.23 

BMS 

28 

10062 

-0.18 

24 

17 

0.51 

0.99 

0.01 

0.81 

-0.34 

0.47 

1.10 

BMS 

29 

1NBT57 

1.19 

70 

43 

0.28 

1.08 

0.69 

1.15 

0.88 

0.37 

0.77 

BMS 

30 

1MD121 

1.74 

72 

39 

0.27 

1.28 

2.47 

1.33 

2.09 

0.22 

0.27 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Appendix C: Distractor Statistics by Test Form 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

30135 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

1 

1 

30135 

A 

1 

15 

88 

2.21 

0.44 

0.89 

0.71 

1 

1 

30135 

B 

0 

1 

6 

-0.89 

0.00 

0.20 

-0.25 

1 

1 

30135 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

1 

30135 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.71 

1 

2 

30718 

* 

-1 

1201 

91 

1.37 

0.04 

0.00 

-0.03 

1 

2 

30718 

A 

1 

103 

87 

1.63 

0.13 

1.12 

0.22 

1 

2 

30718 

B 

0 

6 

5 

0.46 

0.34 

0.75 

-0.19 

1 

2 

30718 

C 

0 

9 

8 

1.00 

0.27 

1.31 

-0.12 

1 

2 

30718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

30711 

* 

-1 

1304 

99 

1.38 

0.04 

0.00 

-0.01 

1 

3 

30711 

A 

1 

10 

67 

2.56 

0.51 

0.59 

0.74 

1 

3 

30711 

B 

0 

2 

13 

-0.04 

0.36 

0.47 

-0.32 

1 

3 

30711 

C 

0 

2 

13 

-0.73 

0.93 

0.32 

-0.46 

1 

3 

30711 

D 

0 

1 

7 

-0.97 

0.00 

0.17 

-0.34 

1 

4 

KG318 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

1 

4 

KG318 

A 

1 

28 

58 

1.22 

0.15 

1.02 

0.38 

1 

4 

KG318 

B 

0 

9 

19 

0.77 

0.15 

0.93 

-0.13 

1 

4 

KG318 

C 

0 

11 

23 

0.51 

0.20 

0.82 

-0.33 

1 

4 

KG318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

30583 

* 

-1 

1297 

98 

1.37 

0.04 

0.00 

-0.05 

1 

5 

30583 

A 

1 

14 

64 

2.71 

0.26 

0.65 

0.66 

1 

5 

30583 

B 

0 

4 

18 

0.63 

0.48 

0.40 

-0.42 

1 

5 

30583 

C 

0 

3 

14 

1.63 

0.54 

1.13 

-0.09 

1 

5 

30583 

D 

0 

1 

5 

-2.21 

0.00 

0.02 

-0.61 

1 

6 

KG339 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

1 

6 

KG339 

A 

1 

25 

52 

2.15 

0.22 

0.99 

0.40 

1 

6 

KG339 

B 

0 

12 

25 

1.05 

0.23 

0.69 

-0.37 

1 

6 

KG339 

C 

0 

11 

23 

1.56 

0.30 

1.29 

-0.09 

1 

6 

KG339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

KMD336 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

1 

7 

KMD336 

A 

1 

42 

82 

1.85 

0.14 

0.82 

0.55 

1 

7 

KMD336 

B 

0 

5 

10 

0.14 

0.33 

0.40 

-0.44 

1 

7 

KMD336 

C 

0 

4 

8 

0.50 

0.38 

0.56 

-0.29 

1 

7 

KMD336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

8 

K0027 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

1 

8 

K0027 

A 

1 

17 

94 

2.45 

0.43 

0.63 

0.50 

1 

8 

K0027 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

8 

K0027 

C 

0 

1 

6 

-1.83 

0.00 

0.10 

-0.50 

1 

8 

K0027 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

9 

K0002 

* 

-1 

1200 

91 

1.42 

0.04 

0.00 

0.07 

1 

9 

K0002 

A 

1 

97 

82 

1.31 

0.13 

0.88 

0.41 

1 

9 

K0002 

B 

0 

7 

6 

-0.11 

0.44 

0.88 

-0.22 

1 

9 

K0002 

C 

0 

15 

13 

-0.07 

0.17 

0.62 

-0.33 

1 

9 

K0002 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

10 

K0019 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

1 

10 

K0019 

A 

1 

14 

78 

2.14 

0.43 

0.64 

0.64 

1 

10 

K0019 

B 

0 

1 

6 

0.10 

0.00 

0.64 

-0.17 

1 

10 

K0019 

C 

0 

1 

6 

-0.62 

0.00 

0.31 

-0.26 

1 

10 

K0019 

D 

0 

2 

11 

-1.38 

1.50 

0.34 

-0.52 

1 

11 

KCC714 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

1 

11 

KCC714 

A 

1 

32 

64 

1.29 

0.22 

0.93 

0.42 

1 

11 

KCC714 

B 

0 

2 

4 

-0.11 

0.79 

0.59 

-0.18 

1 

11 

KCC714 

C 

0 

16 

32 

0.31 

0.15 

0.80 

-0.36 

1 

11 

KCC714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

KCC71 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

1 

12 

KCC71 

A 

1 

30 

64 

1.68 

0.24 

1.25 

0.27 

1 

12 

KCC71 

B 

0 

8 

17 

1.22 

0.35 

1.54 

-0.08 

1 

12 

KCC71 

C 

0 

9 

19 

0.85 

0.23 

0.84 

-0.25 

1 

12 

KCC71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

K0430 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

1 

13 

K0430 

A 

1 

16 

89 

1.96 

0.43 

0.61 

0.59 

1 

13 

K0430 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

13 

K0430 

C 

0 

1 

6 

-0.99 

0.00 

0.30 

-0.32 

1 

13 

K0430 

D 

0 

1 

6 

-2.37 

0.00 

0.08 

-0.49 

1 

14 

K0390 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

1 

14 

K0390 

A 

1 

15 

79 

1.69 

0.47 

0.89 

0.56 

1 

14 

K0390 

B 

0 

1 

5 

-0.29 

0.00 

0.48 

-0.15 

1 

14 

K0390 

C 

0 

2 

11 

-0.26 

0.62 

0.59 

-0.22 

1 

14 

K0390 

D 

0 

1 

5 

-4.07 

0.00 

0.00 

-0.57 

1 

15 

K0308 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

1 

15 

K0308 

A 

1 

13 

76 

1.59 

0.50 

1.09 

0.32 

1 

15 

K0308 

B 

0 

3 

18 

0.69 

0.59 

1.67 

-0.17 

1 

15 

K0308 

C 

0 

1 

6 

-0.72 

0.00 

0.28 

-0.30 

1 

15 

K0308 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

16 

K0474 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

1 

16 

K0474 

A 

1 

14 

78 

2.28 

0.25 

0.69 

0.69 

1 

16 

K0474 

B 

0 

2 

11 

0.38 

1.07 

0.57 

-0.43 

1 

16 

K0474 

C 

0 

2 

11 

0.22 

0.17 

0.30 

-0.48 

1 

16 

K0474 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

17 

K0372 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

1 

17 

K0372 

A 

1 

10 

59 

2.76 

0.46 

0.94 

0.45 

1 

17 

K0372 

B 

0 

1 

6 

0.75 

0.00 

0.35 

-0.16 

1 

17 

K0372 

C 

0 

5 

29 

2.00 

0.32 

1.52 

0.00 

1 

17 

K0372 

D 

0 

1 

6 

-4.14 

0.00 

0.00 

-0.78 

1 

18 

K0150 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.06 

1 

18 

K0150 

A 

1 

15 

83 

1.03 

0.35 

0.68 

0.58 

1 

18 

KOI 50 

B 

0 

2 

11 

-0.38 

0.58 

0.84 

-0.20 

1 

18 

K0150 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

18 

K0150 

D 

0 

1 

6 

-4.14 

0.00 

0.02 

-0.67 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

KOA215 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

1 

19 

KOA215 

A 

1 

40 

85 

1.63 

0.18 

0.91 

0.38 

1 

19 

KOA215 

B 

0 

4 

9 

0.72 

0.47 

1.01 

-0.19 

1 

19 

KOA215 

C 

0 

3 

6 

-0.05 

0.39 

0.39 

-0.33 

1 

19 

KOA215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

20 

31212 

* 

-1 

1297 

98 

1.39 

0.04 

0.00 

0.03 

1 

20 

31212 

A 

1 

16 

73 

1.33 

0.33 

1.14 

0.33 

1 

20 

31212 

B 

0 

5 

23 

0.41 

0.54 

1.18 

-0.28 

1 

20 

31212 

C 

0 

1 

5 

0.22 

0.00 

0.61 

-0.15 

1 

20 

31212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

21 

K0128 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.05 

1 

21 

K0128 

A 

1 

9 

60 

1.79 

0.51 

0.71 

0.60 

1 

21 

K0128 

B 

0 

2 

13 

-2.28 

2.73 

0.75 

-0.47 

1 

21 

K0128 

C 

0 

3 

20 

0.57 

0.60 

1.25 

-0.01 

1 

21 

K0128 

D 

0 

1 

7 

-4.14 

0.00 

0.01 

-0.52 

1 

22 

KOA118 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

1 

22 

KOA118 

A 

1 

26 

55 

1.71 

0.28 

1.47 

0.25 

1 

22 

KOA118 

B 

0 

6 

13 

1.01 

0.34 

0.97 

-0.14 

1 

22 

KOA118 

C 

0 

15 

32 

1.15 

0.18 

1.06 

-0.17 

1 

22 

KOA118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

23 

KNBT14 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

1 

23 

KNBT14 

A 

1 

28 

56 

1.39 

0.21 

0.91 

0.47 

1 

23 

KNBT14 

B 

0 

13 

26 

0.42 

0.28 

0.99 

-0.26 

1 

23 

KNBT14 

C 

0 

9 

18 

0.15 

0.26 

0.67 

-0.32 

1 

23 

KNBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

24 

KNBT129 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

1 

24 

KNBT129 

A 

1 

22 

46 

1.40 

0.16 

0.89 

0.35 

1 

24 

KNBT129 

B 

0 

13 

27 

0.67 

0.26 

0.98 

-0.24 

1 

24 

KNBT129 

C 

0 

13 

27 

0.82 

0.30 

1.33 

-0.15 

1 

24 

KNBT129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

KNBT163 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

1 

25 

KNBT163 

A 

1 

16 

33 

2.46 

0.32 

1.40 

0.47 

1 

25 

KNBT163 

B 

0 

16 

33 

1.35 

0.22 

0.94 

-0.25 

1 

25 

KNBT163 

C 

0 

16 

33 

1.41 

0.19 

0.85 

-0.21 

1 

25 

KNBT163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

K0545 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.03 

2 

1 

K0545 

A 

1 

22 

96 

1.80 

0.35 

1.12 

0.10 

2 

1 

K0545 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

1 

K0545 

C 

0 

1 

4 

1.04 

0.00 

1.36 

-0.10 

2 

1 

K0545 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

30715 

* 

-1 

1215 

92 

1.39 

0.04 

0.00 

0.02 

2 

2 

30715 

A 

1 

89 

86 

1.38 

0.12 

1.06 

0.26 

2 

2 

30715 

B 

0 

3 

3 

0.92 

0.24 

1.13 

-0.05 

2 

2 

30715 

C 

0 

12 

12 

0.43 

0.19 

0.78 

-0.26 

2 

2 

30715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

3 

30414 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

2 

3 

30414 

A 

1 

13 

68 

2.18 

0.52 

1.33 

0.46 

2 

3 

30414 

B 

0 

1 

5 

-0.88 

0.00 

0.17 

-0.31 

2 

3 

30414 

C 

0 

2 

11 

1.54 

0.65 

2.33 

-0.01 

2 

3 

30414 

D 

0 

3 

16 

-0.08 

0.97 

0.96 

-0.39 

2 

4 

31162 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

2 

4 

31162 

A 

1 

13 

72 

2.23 

0.36 

0.94 

0.44 

2 

4 

31162 

B 

0 

2 

11 

1.47 

0.97 

1.67 

-0.09 

2 

4 

31162 

C 

0 

2 

11 

1.30 

0.65 

1.15 

-0.14 

2 

4 

31162 

D 

0 

1 

6 

-1.29 

0.00 

0.07 

-0.55 

2 

5 

KG515 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

2 

5 

KG515 

A 

1 

26 

50 

1.62 

0.20 

1.19 

0.23 

2 

5 

KG515 

B 

0 

10 

19 

0.66 

0.18 

0.55 

-0.40 

2 

5 

KG515 

C 

0 

16 

31 

1.52 

0.17 

1.42 

0.09 

2 

5 

KG515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

6 

KG62 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

2 

6 

KG62 

A 

1 

16 

32 

1.65 

0.39 

1.08 

0.43 

2 

6 

KG62 

B 

0 

26 

52 

0.59 

0.15 

0.94 

-0.30 

2 

6 

KG62 

C 

0 

8 

16 

0.54 

0.28 

0.85 

-0.14 

2 

6 

KG62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

KMD311 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

2 

7 

KMD311 

A 

1 

41 

80 

1.62 

0.14 

0.96 

0.43 

2 

7 

KMD311 

B 

0 

6 

12 

0.75 

0.14 

0.67 

-0.27 

2 

7 

KMD311 

C 

0 

4 

8 

0.44 

0.19 

0.50 

-0.31 

2 

7 

KMD311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

8 

KCC511 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

2 

8 

KCC511 

A 

1 

46 

94 

1.18 

0.14 

0.94 

0.31 

2 

8 

KCC511 

B 

0 

2 

4 

0.39 

0.00 

0.75 

-0.14 

2 

8 

KCC511 

C 

0 

1 

2 

-1.14 

0.00 

0.16 

-0.32 

2 

8 

KCC511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

9 

KCC513 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

2 

9 

KCC513 

A 

1 

45 

88 

1.71 

0.15 

0.91 

0.35 

2 

9 

KCC513 

B 

0 

3 

6 

0.67 

1.00 

1.44 

-0.21 

2 

9 

KCC513 

C 

0 

3 

6 

0.40 

0.51 

0.57 

-0.27 

2 

9 

KCC513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

10 

KCC75 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

2 

10 

KCC75 

A 

1 

43 

83 

1.51 

0.14 

0.99 

0.26 

2 

10 

KCC75 

B 

0 

6 

12 

0.99 

0.41 

1.23 

-0.16 

2 

10 

KCC75 

C 

0 

3 

6 

0.63 

0.14 

0.60 

-0.21 

2 

10 

KCC75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

11 

K0059 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

2 

11 

K0059 

A 

1 

13 

72 

2.57 

0.45 

0.71 

0.63 

2 

11 

K0059 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

11 

K0059 

C 

0 

3 

17 

0.64 

0.92 

1.46 

-0.25 

2 

11 

K0059 

D 

0 

2 

11 

-1.68 

0.56 

0.08 

-0.60 

2 

12 

KCC519 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

2 

12 

KCC519 

A 

1 

29 

62 

1.68 

0.24 

1.21 

0.26 

2 

12 

KCC519 

B 

0 

4 

9 

0.93 

0.79 

1.61 

-0.13 

2 

12 

KCC519 

C 

0 

14 

30 

1.09 

0.17 

1.02 

-0.20 

2 

12 

KCC519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

K0353 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

2 

13 

K0353 

A 

1 

17 

89 

1.85 

0.39 

0.65 

0.54 

2 

13 

K0353 

B 

0 

1 

5 

-0.32 

0.00 

0.47 

-0.24 

2 

13 

K0353 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

13 

K0353 

D 

0 

1 

5 

-2.37 

0.00 

0.06 

-0.51 

2 

14 

K0489 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

2 

14 

K0489 

A 

1 

16 

89 

2.40 

0.36 

0.60 

0.61 

2 

14 

K0489 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

14 

K0489 

C 

0 

1 

6 

0.16 

0.00 

0.46 

-0.26 

2 

14 

K0489 

D 

0 

1 

6 

-2.09 

0.00 

0.05 

-0.58 

2 

15 

K0441 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

2 

15 

K0441 

A 

1 

14 

78 

2.05 

0.38 

0.83 

0.64 

2 

15 

K0441 

B 

0 

2 

11 

-2.71 

2.30 

0.23 

-0.68 

2 

15 

K0441 

C 

0 

1 

6 

0.17 

0.00 

0.42 

-0.13 

2 

15 

K0441 

D 

0 

1 

6 

0.47 

0.00 

0.56 

-0.10 

2 

16 

K0469 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

2 

16 

K0469 

A 

1 

12 

67 

1.54 

0.44 

1.03 

0.35 

2 

16 

K0469 

B 

0 

3 

17 

0.72 

0.76 

1.36 

-0.16 

2 

16 

K0469 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

16 

K0469 

D 

0 

3 

17 

0.32 

0.06 

0.61 

-0.29 

2 

17 

K0366 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

2 

17 

K0366 

A 

1 

9 

50 

2.86 

0.37 

0.55 

0.65 

2 

17 

K0366 

B 

0 

6 

33 

-0.16 

1.06 

0.67 

-0.48 

2 

17 

K0366 

C 

0 

1 

6 

1.88 

0.00 

1.22 

0.05 

2 

17 

K0366 

D 

0 

2 

11 

-0.91 

1.45 

0.17 

-0.36 

2 

18 

K0151 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

2 

18 

K0151 

A 

1 

16 

89 

1.85 

0.43 

0.73 

0.54 

2 

18 

K0151 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

18 

K0151 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

18 

K0151 

D 

0 

2 

11 

-1.32 

0.31 

0.21 

-0.54 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

KOOlO 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

2 

19 

KOOlO 

A 

1 

14 

82 

2.47 

0.43 

0.75 

0.69 

2 

19 

KOOlO 

B 

0 

2 

12 

-0.27 

0.11 

0.28 

-0.32 

2 

19 

KOOlO 

C 

0 

1 

6 

-4.40 

0.00 

0.00 

-0.68 

2 

19 

KOOlO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

20 

K0075 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

2 

20 

K0075 

A 

1 

14 

78 

1.73 

0.30 

1.02 

0.50 

2 

20 

K0075 

B 

0 

2 

11 

-1.52 

3.60 

2.37 

-0.51 

2 

20 

K0075 

C 

0 

2 

11 

0.41 

0.87 

0.62 

-0.15 

2 

20 

K0075 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

21 

K0057 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

2 

21 

K0057 

A 

1 

13 

72 

2.14 

0.34 

0.69 

0.60 

2 

21 

K0057 

B 

0 

2 

11 

0.80 

0.53 

0.77 

-0.20 

2 

21 

K0057 

C 

0 

3 

17 

-0.15 

0.71 

0.44 

-0.55 

2 

21 

K0057 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

22 

30601 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.06 

2 

22 

30601 

A 

1 

11 

69 

2.85 

0.46 

0.82 

0.59 

2 

22 

30601 

B 

0 

1 

6 

-0.19 

0.00 

0.17 

-0.40 

2 

22 

30601 

C 

0 

1 

6 

0.87 

0.00 

0.48 

-0.22 

2 

22 

30601 

D 

0 

3 

19 

1.18 

0.36 

0.75 

-0.32 

2 

23 

KNBT16 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

2 

23 

KNBT16 

A 

1 

29 

60 

1.28 

0.16 

1.00 

0.32 

2 

23 

KNBT16 

B 

0 

8 

17 

0.74 

0.43 

1.45 

-0.14 

2 

23 

KNBT16 

C 

0 

11 

23 

0.63 

0.23 

0.92 

-0.24 

2 

23 

KNBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

24 

KNBT159 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

2 

24 

KNBT159 

A 

1 

21 

44 

1.07 

0.18 

1.23 

0.10 

2 

24 

KNBT159 

B 

0 

18 

38 

0.81 

0.18 

1.04 

-0.17 

2 

24 

KNBT159 

C 

0 

9 

19 

1.11 

0.23 

1.42 

0.08 

2 

24 

KNBT159 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

KNBT160 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

2 

25 

KNBT160 

A 

1 

12 

25 

1.76 

0.44 

1.22 

0.31 

2 

25 

KNBT160 

B 

0 

26 

54 

1.04 

0.19 

1.29 

-0.10 

2 

25 

KNBT160 

C 

0 

10 

21 

0.68 

0.25 

0.75 

-0.21 

2 

25 

KNBT160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

K0546 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.04 

3 

1 

K0546 

A 

1 

15 

94 

2.06 

0.53 

0.82 

0.37 

3 

1 

K0546 

B 

0 

1 

6 

-1.09 

0.00 

0.25 

-0.37 

3 

1 

K0546 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

1 

K0546 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

2 

30706 

* 

-1 

1306 

99 

1.39 

0.04 

0.00 

0.08 

3 

2 

30706 

A 

1 

9 

69 

0.96 

0.50 

1.15 

0.56 

3 

2 

30706 

B 

0 

2 

15 

-0.75 

0.27 

0.40 

-0.20 

3 

2 

30706 

C 

0 

2 

15 

-2.20 

2.81 

1.50 

-0.51 

3 

2 

30706 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

3 

30408 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.02 

3 

3 

30408 

A 

1 

13 

65 

2.33 

0.44 

0.77 

0.64 

3 

3 

30408 

B 

0 

3 

15 

0.95 

0.74 

1.45 

-0.02 

3 

3 

30408 

C 

0 

3 

15 

-1.92 

1.55 

0.22 

-0.48 

3 

3 

30408 

D 

0 

1 

5 

-5.41 

0.00 

0.00 

-0.57 

3 

4 

30112 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

3 

4 

30112 

A 

1 

10 

63 

2.48 

0.64 

0.78 

0.60 

3 

4 

30112 

B 

0 

1 

6 

1.28 

0.00 

1.88 

-0.04 

3 

4 

30112 

C 

0 

4 

25 

-0.19 

0.44 

0.58 

-0.50 

3 

4 

30112 

D 

0 

1 

6 

-0.47 

0.00 

0.33 

-0.26 

3 

5 

31021 

* 

-1 

1307 

99 

1.39 

0.04 

0.00 

0.02 

3 

5 

31021 

A 

1 

6 

50 

2.46 

0.72 

0.97 

0.56 

3 

5 

31021 

B 

0 

2 

17 

1.78 

1.65 

4.40 

0.13 

3 

5 

31021 

C 

0 

1 

8 

1.30 

0.00 

1.02 

0.03 

3 

5 

31021 

D 

0 

3 

25 

-2.32 

1.20 

0.14 

-0.77 

3 

6 

KG337 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

3 

6 

KG337 

A 

1 

19 

37 

2.16 

0.24 

0.76 

0.59 

3 

6 

KG337 

B 

0 

20 

39 

0.85 

0.22 

0.87 

-0.29 

3 

6 

KG337 

C 

0 

12 

24 

0.56 

0.21 

0.53 

-0.34 

3 

6 

KG337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

K0393 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

3 

7 

K0393 

A 

1 

12 

67 

1.99 

0.44 

1.43 

0.59 

3 

7 

K0393 

B 

0 

1 

6 

0.61 

0.00 

0.63 

-0.06 

3 

7 

K0393 

C 

0 

4 

22 

-1.30 

1.28 

0.40 

-0.62 

3 

7 

K0393 

D 

0 

1 

6 

0.75 

0.00 

0.72 

-0.04 

3 

8 

KCC64 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

3 

8 

KCC64 

A 

1 

46 

94 

1.22 

0.17 

1.02 

0.23 

3 

8 

KCC64 

B 

0 

1 

2 

-0.02 

0.00 

0.50 

-0.15 

3 

8 

KCC64 

C 

0 

2 

4 

0.22 

0.08 

0.65 

-0.17 

3 

8 

KCC64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

9 

KCC23 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

3 

9 

KCC23 

A 

1 

45 

88 

1.72 

0.16 

1.03 

0.38 

3 

9 

KCC23 

B 

0 

3 

6 

0.79 

0.17 

0.69 

-0.18 

3 

9 

KCC23 

C 

0 

3 

6 

0.11 

0.26 

0.36 

-0.34 

3 

9 

KCC23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

10 

KCC112 

* 

-1 

1217 

92 

1.38 

0.04 

0.00 

-0.01 

3 

10 

KCC112 

A 

1 

83 

81 

1.69 

0.11 

0.92 

0.49 

3 

10 

KCC112 

B 

0 

12 

12 

0.21 

0.23 

0.55 

-0.39 

3 

10 

KCC112 

C 

0 

7 

7 

0.36 

0.27 

0.58 

-0.26 

3 

10 

KCC112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

11 

KCC76 

* 

-1 

1219 

92 

1.42 

0.04 

0.00 

0.09 

3 

11 

KCC76 

A 

1 

64 

64 

1.30 

0.15 

0.92 

0.44 

3 

11 

KCC76 

B 

0 

22 

22 

0.36 

0.12 

0.81 

-0.26 

3 

11 

KCC76 

C 

0 

14 

14 

0.05 

0.26 

0.76 

-0.30 

3 

11 

KCC76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

12 

KCC720 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

3 

12 

KCC720 

A 

1 

30 

59 

1.70 

0.21 

1.09 

0.44 

3 

12 

KCC720 

B 

0 

3 

6 

0.03 

0.74 

0.52 

-0.27 

3 

12 

KCC720 

C 

0 

18 

35 

0.77 

0.19 

0.91 

-0.32 

3 

12 

KCC720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

KMD19 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

3 

13 

KMD19 

A 

1 

44 

88 

1.12 

0.16 

0.82 

0.48 

3 

13 

KMD19 

B 

0 

5 

10 

-0.71 

0.38 

0.38 

-0.47 

3 

13 

KMD19 

C 

0 

1 

2 

0.18 

0.00 

0.72 

-0.09 

3 

13 

KMD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

14 

K0368 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

3 

14 

K0368 

A 

1 

14 

82 

2.31 

0.33 

0.28 

0.83 

3 

14 

K0368 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

14 

K0368 

C 

0 

1 

6 

-0.88 

0.00 

0.28 

-0.27 

3 

14 

K0368 

D 

0 

2 

12 

-3.25 

0.89 

0.04 

-0.79 

3 

15 

K0313 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

3 

15 

K0313 

A 

1 

15 

79 

1.80 

0.34 

0.87 

0.52 

3 

15 

K0313 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

15 

K0313 

C 

0 

1 

5 

-0.64 

0.00 

0.23 

-0.31 

3 

15 

K0313 

D 

0 

3 

16 

-0.03 

1.18 

1.15 

-0.40 

3 

16 

K0473 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.04 

3 

16 

K0473 

A 

1 

13 

65 

1.50 

0.37 

0.94 

0.45 

3 

16 

K0473 

B 

0 

5 

25 

0.85 

0.42 

1.37 

-0.03 

3 

16 

K0473 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

16 

K0473 

D 

0 

2 

10 

-2.59 

1.47 

0.14 

-0.68 

3 

17 

K0384 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

3 

17 

K0384 

A 

1 

8 

44 

2.88 

0.69 

1.08 

0.66 

3 

17 

K0384 

B 

0 

3 

17 

-0.68 

0.21 

0.16 

-0.50 

3 

17 

K0384 

C 

0 

5 

28 

1.17 

0.32 

1.18 

-0.09 

3 

17 

K0384 

D 

0 

2 

11 

-0.24 

0.89 

0.34 

-0.31 

3 

18 

KOI 44 

* 

-1 

1301 

99 

1.40 

0.04 

0.00 

0.08 

3 

18 

KOI 44 

A 

1 

14 

78 

1.18 

0.42 

0.98 

0.69 

3 

18 

KOI 44 

B 

0 

1 

6 

0.27 

0.00 

1.11 

0.00 

3 

18 

KOI 44 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

18 

KOI 44 

D 

0 

3 

17 

-3.70 

1.24 

0.23 

-0.76 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

K0155 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.07 

3 

19 

K0155 

A 

1 

15 

88 

2.58 

0.43 

0.70 

0.48 

3 

19 

K0155 

B 

0 

2 

12 

-0.14 

1.52 

0.76 

-0.48 

3 

19 

KOI 55 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

19 

K0155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

20 

K0071 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.03 

3 

20 

K0071 

A 

1 

16 

80 

2.28 

0.36 

0.59 

0.66 

3 

20 

K0071 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

20 

K0071 

C 

0 

2 

10 

-0.17 

0.30 

0.34 

-0.38 

3 

20 

K0071 

D 

0 

2 

10 

-0.74 

0.23 

0.19 

-0.50 

3 

21 

K0021 

* 

-1 

815 

62 

1.32 

0.05 

0.00 

-0.05 

3 

21 

K0021 

A 

1 

346 

69 

2.20 

0.08 

0.93 

0.58 

3 

21 

K0021 

B 

0 

48 

10 

0.38 

0.19 

1.10 

-0.20 

3 

21 

K0021 

C 

0 

77 

15 

0.15 

0.12 

0.63 

-0.31 

3 

21 

K0021 

D 

0 

33 

7 

-1.25 

0.33 

0.37 

-0.40 

3 

22 

KOI 74 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

3 

22 

KOI 74 

A 

1 

12 

67 

2.97 

0.42 

0.66 

0.69 

3 

22 

KOI 74 

B 

0 

4 

22 

1.03 

0.12 

0.72 

-0.27 

3 

22 

KOI 74 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

22 

KOI 74 

D 

0 

2 

11 

-1.81 

1.07 

0.07 

-0.68 

3 

23 

KNBT139 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

3 

23 

KNBT139 

A 

1 

27 

54 

1.42 

0.25 

0.94 

0.47 

3 

23 

KNBT139 

B 

0 

8 

16 

0.31 

0.26 

0.85 

-0.23 

3 

23 

KNBT139 

C 

0 

15 

30 

0.34 

0.16 

0.76 

-0.33 

3 

23 

KNBT139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

24 

KNBT115 

* 

-1 

1220 

92 

1.40 

0.04 

0.00 

0.03 

3 

24 

KNBT115 

A 

1 

46 

46 

1.75 

0.23 

1.35 

0.37 

3 

24 

KNBT115 

B 

0 

29 

29 

0.70 

0.17 

0.99 

-0.24 

3 

24 

KNBT115 

C 

0 

24 

24 

0.76 

0.19 

0.99 

-0.18 

3 

24 

KNBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

KNBT133 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

3 

25 

KNBT133 

A 

1 

21 

40 

2.47 

0.27 

1.01 

0.45 

3 

25 

KNBT133 

B 

0 

13 

25 

1.62 

0.24 

1.21 

-0.11 

3 

25 

KNBT133 

C 

0 

18 

35 

1.24 

0.23 

0.81 

-0.37 

3 

25 

KNBT133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

K0550 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

4 

1 

K0550 

A 

1 

17 

94 

1.80 

0.33 

0.80 

0.46 

4 

1 

K0550 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

1 

K0550 

C 

0 

1 

6 

-1.12 

0.00 

0.15 

-0.46 

4 

1 

K0550 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

2 

30251 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

4 

2 

30251 

A 

1 

15 

83 

1.98 

0.45 

0.66 

0.55 

4 

2 

30251 

B 

0 

1 

6 

0.07 

0.00 

0.72 

-0.19 

4 

2 

30251 

C 

0 

1 

6 

-0.12 

0.00 

0.60 

-0.21 

4 

2 

30251 

D 

0 

1 

6 

-2.37 

0.00 

0.06 

-0.50 

4 

3 

K0516 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

4 

3 

K0516 

A 

1 

12 

71 

2.24 

0.37 

0.74 

0.64 

4 

3 

K0516 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

3 

K0516 

C 

0 

3 

18 

0.28 

0.53 

0.55 

-0.42 

4 

3 

K0516 

D 

0 

2 

12 

-0.04 

1.03 

0.48 

-0.41 

4 

4 

30412 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.01 

4 

4 

30412 

A 

1 

15 

65 

2.76 

0.36 

0.59 

0.77 

4 

4 

30412 

B 

0 

2 

9 

0.10 

0.61 

0.46 

-0.18 

4 

4 

30412 

C 

0 

4 

17 

-0.30 

0.52 

0.37 

-0.34 

4 

4 

30412 

D 

0 

2 

9 

-3.61 

1.40 

0.04 

-0.66 

4 

5 

30418 

* 

-1 

1310 

99 

1.39 

0.04 

0.00 

0.04 

4 

5 

30418 

A 

1 

4 

44 

2.40 

0.41 

0.46 

0.66 

4 

5 

30418 

B 

0 

1 

11 

0.22 

0.00 

0.31 

-0.08 

4 

5 

30418 

C 

0 

2 

22 

0.71 

0.44 

0.55 

-0.01 

4 

5 

30418 

D 

0 

2 

22 

-2.31 

2.61 

0.33 

-0.72 

4 

6 

KG320 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

4 

6 

KG320 

A 

1 

25 

49 

2.05 

0.19 

0.90 

0.44 

4 

6 

KG320 

B 

0 

7 

14 

0.56 

0.35 

0.49 

-0.38 

4 

6 

KG320 

C 

0 

19 

37 

1.32 

0.22 

1.20 

-0.19 

4 

6 

KG320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

KMD310 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

4 

7 

KMD310 

A 

1 

36 

77 

1.65 

0.20 

1.03 

0.32 

4 

7 

KMD310 

B 

0 

5 

11 

0.62 

0.54 

1.33 

-0.24 

4 

7 

KMD310 

C 

0 

6 

13 

0.89 

0.36 

1.09 

-0.18 

4 

7 

KMD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

8 

KCC322 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.02 

4 

8 

KCC322 

A 

1 

47 

94 

1.30 

0.17 

0.98 

0.28 

4 

8 

KCC322 

B 

0 

1 

2 

0.39 

0.00 

0.72 

-0.10 

4 

8 

KCC322 

C 

0 

2 

4 

-0.33 

0.10 

0.35 

-0.27 

4 

8 

KCC322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

9 

K0093 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

4 

9 

K0093 

A 

1 

14 

78 

1.84 

0.41 

0.56 

0.68 

4 

9 

K0093 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

9 

K0093 

C 

0 

1 

6 

-1.62 

0.00 

0.14 

-0.35 

4 

9 

K0093 

D 

0 

3 

17 

-1.17 

0.80 

0.39 

-0.54 

4 

10 

KOI 27 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

4 

10 

KOI 27 

A 

1 

14 

78 

1.74 

0.25 

0.75 

0.69 

4 

10 

KOI 27 

B 

0 

1 

6 

0.72 

0.00 

0.66 

-0.05 

4 

10 

KOI 27 

C 

0 

2 

11 

-0.30 

0.10 

0.24 

-0.27 

4 

10 

KOI 27 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.82 

4 

11 

KCC715 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

4 

11 

KCC715 

A 

1 

32 

64 

1.39 

0.18 

0.80 

0.56 

4 

11 

KCC715 

B 

0 

11 

22 

-0.07 

0.26 

0.58 

-0.46 

4 

11 

KCC715 

C 

0 

7 

14 

0.28 

0.26 

0.76 

-0.22 

4 

11 

KCC715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

12 

KCC722 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

4 

12 

KCC722 

A 

1 

37 

71 

2.15 

0.18 

0.90 

0.44 

4 

12 

KCC722 

B 

0 

6 

12 

0.68 

0.31 

0.49 

-0.36 

4 

12 

KCC722 

C 

0 

9 

17 

1.27 

0.33 

1.07 

-0.22 

4 

12 

KCC722 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

K0350 

* 

-1 

1302 

99 

1.40 

0.04 

0.00 

0.13 

4 

13 

K0350 

A 

1 

12 

71 

0.38 

0.35 

1.05 

0.62 

4 

13 

K0350 

B 

0 

2 

12 

-1.24 

0.60 

0.51 

-0.21 

4 

13 

K0350 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

13 

K0350 

D 

0 

3 

18 

-2.30 

1.34 

0.84 

-0.56 

4 

14 

KMDllO 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

4 

14 

KMDllO 

A 

1 

41 

85 

1.23 

0.13 

0.88 

0.47 

4 

14 

KMDllO 

B 

0 

5 

10 

-0.28 

0.28 

0.41 

-0.48 

4 

14 

KMDllO 

C 

0 

2 

4 

0.59 

0.54 

0.97 

-0.10 

4 

14 

KMDllO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

15 

K0420 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

4 

15 

K0420 

A 

1 

14 

78 

2.06 

0.45 

1.06 

0.57 

4 

15 

K0420 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

15 

K0420 

C 

0 

2 

11 

0.14 

0.25 

0.48 

-0.19 

4 

15 

K0420 

D 

0 

2 

11 

-2.27 

3.14 

0.98 

-0.56 

4 

16 

K0354 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

4 

16 

K0354 

A 

1 

11 

61 

2.31 

0.53 

0.82 

0.68 

4 

16 

K0354 

B 

0 

2 

11 

0.24 

0.97 

1.10 

-0.15 

4 

16 

K0354 

C 

0 

3 

17 

-0.14 

0.41 

0.58 

-0.27 

4 

16 

K0354 

D 

0 

2 

11 

-2.36 

0.72 

0.07 

-0.58 

4 

17 

K0451 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

4 

17 

K0451 

A 

1 

8 

42 

2.21 

0.53 

1.07 

0.45 

4 

17 

K0451 

B 

0 

4 

21 

1.81 

0.59 

2.14 

0.16 

4 

17 

K0451 

C 

0 

4 

21 

1.08 

0.43 

0.96 

-0.05 

4 

17 

K0451 

D 

0 

3 

16 

-1.78 

0.90 

0.09 

-0.72 

4 

18 

K0003 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

4 

18 

K0003 

A 

1 

17 

94 

2.09 

0.36 

0.96 

0.39 

4 

18 

K0003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

18 

K0003 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

18 

K0003 

D 

0 

1 

6 

-0.51 

0.00 

0.23 

-0.39 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

K0083 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

4 

19 

K0083 

A 

1 

14 

78 

2.06 

0.49 

1.02 

0.61 

4 

19 

K0083 

B 

0 

1 

6 

-0.15 

0.00 

0.49 

-0.16 

4 

19 

K0083 

C 

0 

1 

6 

-0.76 

0.00 

0.26 

-0.22 

4 

19 

K0083 

D 

0 

2 

11 

-2.07 

2.33 

0.73 

-0.53 

4 

20 

K0028 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

4 

20 

K0028 

A 

1 

15 

83 

2.54 

0.44 

1.17 

0.49 

4 

20 

K0028 

B 

0 

3 

17 

0.22 

0.50 

0.55 

-0.49 

4 

20 

K0028 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

20 

K0028 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

21 

K0061 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

4 

21 

K0061 

A 

1 

13 

72 

2.50 

0.43 

0.69 

0.64 

4 

21 

K0061 

B 

0 

2 

11 

0.75 

0.24 

0.78 

-0.22 

4 

21 

K0061 

C 

0 

2 

11 

-0.60 

0.54 

0.23 

-0.50 

4 

21 

K0061 

D 

0 

1 

6 

-0.06 

0.00 

0.34 

-0.27 

4 

22 

K0048 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

4 

22 

K0048 

A 

1 

10 

53 

1.61 

0.38 

1.11 

0.45 

4 

22 

K0048 

B 

0 

1 

5 

1.85 

0.00 

2.13 

0.15 

4 

22 

K0048 

C 

0 

6 

32 

0.77 

0.22 

0.80 

-0.23 

4 

22 

K0048 

D 

0 

2 

11 

-0.48 

0.27 

0.21 

-0.50 

4 

23 

KNBT135 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

4 

23 

KNBT135 

A 

1 

31 

66 

1.84 

0.21 

0.90 

0.47 

4 

23 

KNBT135 

B 

0 

12 

26 

0.59 

0.24 

0.75 

-0.42 

4 

23 

KNBT135 

C 

0 

4 

9 

0.94 

0.42 

1.02 

-0.13 

4 

23 

KNBT135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

24 

KNBT165 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

4 

24 

KNBT165 

A 

1 

21 

44 

1.50 

0.21 

1.04 

0.37 

4 

24 

KNBT165 

B 

0 

15 

31 

0.46 

0.22 

0.74 

-0.41 

4 

24 

KNBT165 

C 

0 

12 

25 

1.09 

0.28 

1.31 

0.01 

4 

24 

KNBT165 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

KNBTlll 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

4 

25 

KNBTlll 

A 

1 

17 

35 

2.44 

0.42 

1.03 

0.46 

4 

25 

KNBTlll 

B 

0 

9 

18 

0.11 

0.29 

0.32 

-0.44 

4 

25 

KNBTlll 

C 

0 

23 

47 

1.33 

0.21 

1.35 

-0.10 

4 

25 

KNBTlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

K0536 

* 

-1 

1206 

91 

1.39 

0.04 

0.00 

0.02 

5 

1 

K0536 

A 

1 

105 

93 

1.36 

0.13 

2.01 

0.24 

5 

1 

K0536 

B 

0 

3 

3 

0.47 

0.97 

2.28 

-0.09 

5 

1 

K0536 

C 

0 

5 

4 

-0.19 

0.25 

0.52 

-0.23 

5 

1 

K0536 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

2 

30256 

* 

-1 

1305 

99 

1.39 

0.04 

0.00 

0.05 

5 

2 

30256 

A 

1 

11 

79 

0.97 

0.28 

0.77 

0.48 

5 

2 

30256 

B 

0 

1 

7 

0.82 

0.00 

1.57 

0.04 

5 

2 

30256 

C 

0 

1 

7 

0.57 

0.00 

1.22 

-0.01 

5 

2 

30256 

D 

0 

1 

7 

-3.08 

0.00 

0.03 

-0.80 

5 

3 

K0505 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

5 

3 

K0505 

A 

1 

11 

61 

1.68 

0.26 

0.52 

0.79 

5 

3 

K0505 

B 

0 

2 

11 

-0.15 

0.32 

0.43 

-0.29 

5 

3 

K0505 

C 

0 

3 

17 

-0.64 

0.54 

0.32 

-0.54 

5 

3 

K0505 

D 

0 

2 

11 

-0.18 

0.78 

0.53 

-0.30 

5 

4 

K0528 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

5 

4 

K0528 

A 

1 

12 

67 

2.01 

0.47 

0.94 

0.39 

5 

4 

K0528 

B 

0 

1 

6 

0.19 

0.00 

0.41 

-0.23 

5 

4 

K0528 

C 

0 

3 

17 

0.52 

0.80 

0.88 

-0.32 

5 

4 

K0528 

D 

0 

2 

11 

1.44 

0.41 

1.53 

-0.04 

5 

5 

30102 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

5 

5 

30102 

A 

1 

10 

56 

2.69 

0.40 

0.76 

0.68 

5 

5 

30102 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

5 

30102 

C 

0 

5 

28 

0.85 

0.44 

0.82 

-0.15 

5 

5 

30102 

D 

0 

3 

17 

-2.17 

1.31 

0.14 

-0.73 

5 

6 

31208 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.03 

5 

6 

31208 

A 

1 

8 

38 

1.93 

0.29 

1.01 

0.38 

5 

6 

31208 

B 

0 

5 

24 

1.94 

0.57 

2.29 

0.27 

5 

6 

31208 

C 

0 

4 

19 

0.80 

0.51 

0.71 

-0.05 

5 

6 

31208 

D 

0 

4 

19 

-1.85 

1.28 

0.26 

-0.72 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

KMD317 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

5 

7 

KMD317 

A 

1 

38 

78 

1.84 

0.24 

0.84 

0.43 

5 

7 

KMD317 

B 

0 

6 

12 

0.74 

0.37 

1.06 

-0.19 

5 

7 

KMD317 

C 

0 

5 

10 

-0.25 

0.46 

0.42 

-0.39 

5 

7 

KMD317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

8 

K0024 

* 

-1 

1202 

91 

1.40 

0.04 

0.00 

0.05 

5 

8 

K0024 

A 

1 

108 

92 

1.31 

0.11 

0.95 

0.41 

5 

8 

K0024 

B 

0 

3 

3 

-0.11 

0.35 

0.51 

-0.16 

5 

8 

K0024 

C 

0 

6 

5 

-1.03 

0.84 

0.49 

-0.38 

5 

8 

K0024 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

9 

KCC59 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

5 

9 

KCC59 

A 

1 

45 

88 

1.75 

0.14 

0.86 

0.45 

5 

9 

KCC59 

B 

0 

1 

2 

-0.93 

0.00 

0.12 

-0.33 

5 

9 

KCC59 

C 

0 

5 

10 

0.51 

0.42 

0.71 

-0.33 

5 

9 

KCC59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

10 

KCC711 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

5 

10 

KCC711 

A 

1 

39 

81 

1.74 

0.20 

0.99 

0.43 

5 

10 

KCC711 

B 

0 

3 

6 

0.12 

0.60 

0.53 

-0.28 

5 

10 

KCC711 

C 

0 

6 

13 

0.43 

0.27 

0.67 

-0.31 

5 

10 

KCC711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

11 

K0062 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

5 

11 

K0062 

A 

1 

13 

68 

2.31 

0.43 

0.61 

0.67 

5 

11 

K0062 

B 

0 

5 

26 

-0.10 

0.39 

0.62 

-0.53 

5 

11 

K0062 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

11 

K0062 

D 

0 

1 

5 

-1.12 

0.00 

0.16 

-0.35 

5 

12 

KCC310 

* 

-1 

1264 

96 

1.36 

0.04 

0.00 

-0.06 

5 

12 

KCC310 

A 

1 

40 

73 

2.01 

0.19 

1.16 

0.29 

5 

12 

KCC310 

B 

0 

5 

9 

1.35 

0.24 

0.93 

-0.12 

5 

12 

KCC310 

C 

0 

10 

18 

1.20 

0.35 

1.40 

-0.24 

5 

12 

KCC310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

K0391 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

5 

13 

K0391 

A 

1 

17 

89 

1.95 

0.32 

0.51 

0.66 

5 

13 

K0391 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

13 

K0391 

C 

0 

1 

5 

-0.47 

0.00 

0.33 

-0.28 

5 

13 

K0391 

D 

0 

1 

5 

-2.88 

0.00 

0.03 

-0.62 

5 

14 

K0462 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

5 

14 

K0462 

A 

1 

15 

83 

1.91 

0.39 

0.58 

0.65 

5 

14 

K0462 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

14 

K0462 

C 

0 

2 

11 

-1.04 

0.03 

0.21 

-0.50 

5 

14 

K0462 

D 

0 

1 

6 

-1.29 

0.00 

0.16 

-0.38 

5 

15 

K0348 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

5 

15 

K0348 

A 

1 

14 

78 

2.21 

0.36 

0.52 

0.72 

5 

15 

K0348 

B 

0 

1 

6 

-0.29 

0.00 

0.36 

-0.25 

5 

15 

K0348 

C 

0 

1 

6 

0.18 

0.00 

0.58 

-0.18 

5 

15 

K0348 

D 

0 

2 

11 

-1.69 

0.68 

0.11 

-0.64 

5 

16 

K0315 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

5 

16 

K0315 

A 

1 

13 

72 

2.20 

0.57 

1.43 

0.30 

5 

16 

K0315 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

16 

K0315 

C 

0 

4 

22 

0.80 

0.32 

0.94 

-0.32 

5 

16 

K0315 

D 

0 

1 

6 

1.85 

0.00 

2.36 

0.00 

5 

17 

K0378 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

5 

17 

K0378 

A 

1 

9 

50 

2.58 

0.55 

1.48 

0.45 

5 

17 

K0378 

B 

0 

3 

17 

0.69 

0.02 

0.37 

-0.19 

5 

17 

K0378 

C 

0 

5 

28 

0.19 

1.43 

1.40 

-0.40 

5 

17 

K0378 

D 

0 

1 

6 

2.64 

0.00 

2.61 

0.12 

5 

18 

KOI 62 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

5 

18 

KOI 62 

A 

1 

17 

94 

2.34 

0.39 

0.64 

0.49 

5 

18 

KOI 62 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

18 

KOI 62 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

18 

KOI 62 

D 

0 

1 

6 

-1.38 

0.00 

0.11 

-0.49 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

K0084 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

5 

19 

K0084 

A 

1 

13 

76 

1.74 

0.39 

0.72 

0.69 

5 

19 

K0084 

B 

0 

1 

6 

0.19 

0.00 

0.67 

-0.08 

5 

19 

K0084 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

19 

K0084 

D 

0 

3 

18 

-2.52 

1.52 

0.38 

-0.72 

5 

20 

K0038 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

5 

20 

K0038 

A 

1 

15 

79 

2.28 

0.42 

1.02 

0.55 

5 

20 

K0038 

B 

0 

2 

11 

1.37 

0.50 

1.48 

-0.04 

5 

20 

K0038 

C 

0 

1 

5 

-0.71 

0.00 

0.16 

-0.25 

5 

20 

K0038 

D 

0 

1 

5 

-5.12 

0.00 

0.00 

-0.71 

5 

21 

KOI 02 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

5 

21 

KOI 02 

A 

1 

12 

67 

2.43 

0.51 

0.92 

0.61 

5 

21 

KOI 02 

B 

0 

1 

6 

0.37 

0.00 

0.69 

-0.14 

5 

21 

KOI 02 

C 

0 

4 

22 

0.15 

0.80 

1.64 

-0.37 

5 

21 

KOI 02 

D 

0 

1 

6 

-2.24 

0.00 

0.05 

-0.45 

5 

22 

K0A41 

* 

-1 

1219 

92 

1.39 

0.04 

0.00 

0.03 

5 

22 

K0A41 

A 

1 

54 

54 

1.61 

0.19 

1.10 

0.33 

5 

22 

K0A41 

B 

0 

15 

15 

0.75 

0.29 

1.21 

-0.17 

5 

22 

K0A41 

C 

0 

31 

31 

0.83 

0.13 

0.98 

-0.22 

5 

22 

K0A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

23 

KNBT146 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

5 

23 

KNBT146 

A 

1 

31 

65 

1.49 

0.20 

0.92 

0.41 

5 

23 

KNBT146 

B 

0 

9 

19 

0.54 

0.28 

0.90 

-0.26 

5 

23 

KNBT146 

C 

0 

8 

17 

0.48 

0.34 

0.89 

-0.26 

5 

23 

KNBT146 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

24 

KNBT113 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

5 

24 

KNBT113 

A 

1 

21 

44 

1.40 

0.23 

1.24 

0.33 

5 

24 

KNBT113 

B 

0 

11 

23 

0.73 

0.18 

0.83 

-0.18 

5 

24 

KNBT113 

C 

0 

16 

33 

0.79 

0.22 

1.02 

-0.19 

5 

24 

KNBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

KNBT131 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

5 

25 

KNBT131 

A 

1 

17 

33 

1.98 

0.28 

0.98 

0.43 

5 

25 

KNBT131 

B 

0 

16 

31 

0.68 

0.18 

0.57 

-0.35 

5 

25 

KNBT131 

C 

0 

18 

35 

1.13 

0.28 

1.32 

-0.09 

5 

25 

KNBT131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


111 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

K0535 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

6 

1 

K0535 

A 

1 

16 

89 

1.81 

0.39 

0.95 

0.66 

6 

1 

K0535 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

1 

K0535 

C 

0 

1 

6 

-0.46 

0.00 

0.32 

-0.20 

6 

1 

K0535 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.70 

6 

2 

KG21 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

6 

2 

KG21 

A 

1 

41 

85 

1.26 

0.18 

1.06 

0.25 

6 

2 

KG21 

B 

0 

4 

8 

0.32 

0.40 

0.81 

-0.22 

6 

2 

KG21 

C 

0 

3 

6 

0.65 

0.46 

1.06 

-0.11 

6 

2 

KG21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

3 

KG330 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

6 

3 

KG330 

A 

1 

31 

62 

1.26 

0.21 

1.04 

0.38 

6 

3 

KG330 

B 

0 

7 

14 

0.14 

0.21 

0.60 

-0.28 

6 

3 

KG330 

C 

0 

12 

24 

0.49 

0.31 

1.06 

-0.21 

6 

3 

KG330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

KG539 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

6 

4 

KG539 

A 

1 

36 

71 

1.91 

0.17 

1.02 

0.49 

6 

4 

KG539 

B 

0 

8 

16 

1.10 

0.28 

0.94 

-0.19 

6 

4 

KG539 

C 

0 

7 

14 

0.38 

0.20 

0.41 

-0.45 

6 

4 

KG539 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

5 

30558 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.05 

6 

5 

30558 

A 

1 

8 

42 

1.84 

0.30 

0.66 

0.50 

6 

5 

30558 

B 

0 

4 

21 

0.78 

0.57 

1.08 

0.00 

6 

5 

30558 

C 

0 

5 

26 

0.84 

0.46 

1.02 

0.02 

6 

5 

30558 

D 

0 

2 

11 

-3.54 

0.60 

0.01 

-0.83 

6 

6 

30560 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

6 

6 

30560 

A 

1 

7 

44 

3.26 

0.53 

0.46 

0.77 

6 

6 

30560 

B 

0 

4 

25 

0.98 

0.49 

0.85 

-0.18 

6 

6 

30560 

C 

0 

1 

6 

1.69 

0.00 

1.32 

0.01 

6 

6 

30560 

D 

0 

4 

25 

-0.77 

0.25 

0.13 

-0.71 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

KMD313 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

6 

7 

KMD313 

A 

1 

37 

76 

1.86 

0.20 

0.97 

0.38 

6 

7 

KMD313 

B 

0 

3 

6 

0.81 

0.37 

0.70 

-0.17 

6 

7 

KMD313 

C 

0 

9 

18 

0.81 

0.23 

0.78 

-0.32 

6 

7 

KMD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

8 

KOI 70 

* 

-1 

1203 

91 

1.39 

0.04 

0.00 

0.01 

6 

8 

KOI 70 

A 

1 

108 

93 

1.44 

0.12 

0.95 

0.27 

6 

8 

KOI 70 

B 

0 

5 

4 

0.32 

0.27 

0.70 

-0.17 

6 

8 

KOI 70 

C 

0 

3 

3 

-0.32 

0.69 

0.47 

-0.21 

6 

8 

KOI 70 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

9 

KCC317 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.02 

6 

9 

KCC317 

A 

1 

45 

88 

1.65 

0.18 

1.00 

0.20 

6 

9 

KCC317 

B 

0 

3 

6 

0.73 

0.95 

1.59 

-0.17 

6 

9 

KCC317 

C 

0 

3 

6 

1.05 

0.28 

1.00 

-0.11 

6 

9 

KCC317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

10 

KCC54 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

6 

10 

KCC54 

A 

1 

39 

80 

1.83 

0.23 

0.83 

0.45 

6 

10 

KCC54 

B 

0 

9 

18 

0.16 

0.35 

0.68 

-0.42 

6 

10 

KCC54 

C 

0 

1 

2 

0.23 

0.00 

0.48 

-0.12 

6 

10 

KCC54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

11 

KCC74 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

6 

11 

KCC74 

A 

1 

34 

72 

1.74 

0.21 

1.05 

0.41 

6 

11 

KCC74 

B 

0 

2 

4 

0.25 

0.24 

0.42 

-0.21 

6 

11 

KCC74 

C 

0 

11 

23 

0.74 

0.20 

0.83 

-0.33 

6 

11 

KCC74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

12 

KCC121 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

6 

12 

KCC121 

A 

1 

30 

61 

1.47 

0.22 

1.17 

0.36 

6 

12 

KCC121 

B 

0 

10 

20 

0.60 

0.30 

0.98 

-0.25 

6 

12 

KCC121 

C 

0 

9 

18 

0.70 

0.23 

0.93 

-0.19 

6 

12 

KCC121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


113 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

K0405 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

6 

13 

K0405 

A 

1 

16 

84 

1.73 

0.44 

0.64 

0.60 

6 

13 

K0405 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

13 

K0405 

C 

0 

2 

11 

-0.81 

0.25 

0.41 

-0.34 

6 

13 

K0405 

D 

0 

1 

5 

-3.08 

0.00 

0.04 

-0.50 

6 

14 

KMD22 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

6 

14 

KMD22 

A 

1 

41 

85 

1.05 

0.13 

1.06 

0.23 

6 

14 

KMD22 

B 

0 

3 

6 

0.47 

0.00 

0.73 

-0.17 

6 

14 

KMD22 

C 

0 

4 

8 

0.62 

0.23 

0.92 

-0.14 

6 

14 

KMD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

15 

K0496 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

6 

15 

K0496 

A 

1 

14 

74 

2.52 

0.48 

0.84 

0.71 

6 

15 

K0496 

B 

0 

2 

11 

-0.92 

0.20 

0.21 

-0.32 

6 

15 

K0496 

C 

0 

2 

11 

-0.43 

1.23 

0.62 

-0.26 

6 

15 

K0496 

D 

0 

1 

5 

-4.92 

0.00 

0.00 

-0.60 

6 

16 

K0491 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

6 

16 

K0491 

A 

1 

13 

72 

2.83 

0.36 

0.58 

0.76 

6 

16 

K0491 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

16 

K0491 

C 

0 

4 

22 

-0.14 

0.37 

0.32 

-0.43 

6 

16 

K0491 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.71 

6 

17 

K0325 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

6 

17 

K0325 

A 

1 

8 

44 

2.74 

0.54 

1.04 

0.60 

6 

17 

K0325 

B 

0 

6 

33 

0.78 

0.35 

0.66 

-0.37 

6 

17 

K0325 

C 

0 

1 

6 

0.72 

0.00 

0.46 

-0.14 

6 

17 

K0325 

D 

0 

3 

17 

0.73 

1.34 

1.21 

-0.25 

6 

18 

KOI 54 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

6 

18 

KOI 54 

A 

1 

15 

83 

1.45 

0.39 

0.67 

0.72 

6 

18 

KOI 54 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

18 

KOI 54 

C 

0 

2 

11 

-3.65 

1.40 

0.10 

-0.71 

6 

18 

KOI 54 

D 

0 

1 

6 

-0.96 

0.00 

0.35 

-0.19 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

KOI 08 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

6 

19 

KOI 08 

A 

1 

15 

83 

1.40 

0.36 

1.13 

0.27 

6 

19 

KOI 08 

B 

0 

1 

6 

1.18 

0.00 

1.56 

-0.01 

6 

19 

KOI 08 

C 

0 

1 

6 

-0.31 

0.00 

0.35 

-0.29 

6 

19 

KOI 08 

D 

0 

1 

6 

0.54 

0.00 

0.82 

-0.13 

6 

20 

KOI 67 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

6 

20 

KOI 67 

A 

1 

13 

72 

2.10 

0.41 

0.66 

0.70 

6 

20 

KOI 67 

B 

0 

1 

6 

0.75 

0.00 

1.01 

-0.04 

6 

20 

KOI 67 

C 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

6 

20 

KOI 67 

D 

0 

3 

17 

-1.00 

0.82 

0.32 

-0.41 

6 

21 

K0016 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

6 

21 

K0016 

A 

1 

14 

74 

2.13 

0.48 

1.47 

0.26 

6 

21 

K0016 

B 

0 

1 

5 

-0.39 

0.00 

0.20 

-0.33 

6 

21 

K0016 

C 

0 

3 

16 

1.80 

0.41 

2.09 

-0.02 

6 

21 

K0016 

D 

0 

1 

5 

0.82 

0.00 

0.67 

-0.15 

6 

22 

30011 

* 

-1 

1308 

99 

1.39 

0.04 

0.00 

0.04 

6 

22 

30011 

A 

1 

5 

45 

0.98 

0.45 

1.11 

0.20 

6 

22 

30011 

B 

0 

4 

36 

0.63 

0.34 

0.99 

-0.16 

6 

22 

30011 

C 

0 

1 

9 

1.57 

0.00 

2.17 

0.30 

6 

22 

30011 

D 

0 

1 

9 

-0.21 

0.00 

0.36 

-0.39 

6 

23 

KNBT156 

* 

-1 

1270 

96 

1.40 

0.04 

0.00 

0.06 

6 

23 

KNBT156 

A 

1 

29 

59 

1.17 

0.26 

1.23 

0.23 

6 

23 

KNBT156 

B 

0 

14 

29 

0.74 

0.14 

1.10 

-0.12 

6 

23 

KNBT156 

C 

0 

6 

12 

0.42 

0.32 

0.91 

-0.17 

6 

23 

KNBT156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

24 

KNBT164 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

6 

24 

KNBT164 

A 

1 

30 

58 

2.33 

0.21 

0.91 

0.50 

6 

24 

KNBT164 

B 

0 

4 

8 

1.05 

0.45 

0.74 

-0.19 

6 

24 

KNBT164 

C 

0 

18 

35 

1.17 

0.19 

0.78 

-0.41 

6 

24 

KNBT164 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

KNBT157 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

6 

25 

KNBT157 

A 

1 

15 

30 

1.65 

0.37 

1.25 

0.42 

6 

25 

KNBT157 

B 

0 

22 

44 

0.51 

0.20 

0.79 

-0.31 

6 

25 

KNBT157 

C 

0 

13 

26 

0.75 

0.19 

0.90 

-0.08 

6 

25 

KNBT157 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

30254 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

7 

1 

30254 

A 

1 

16 

94 

1.46 

0.34 

1.00 

0.25 

7 

1 

30254 

B 

0 

1 

6 

0.05 

0.00 

0.49 

-0.25 

7 

1 

30254 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

1 

30254 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

2 

30725 

* 

-1 

1204 

91 

1.38 

0.04 

0.00 

0.00 

7 

2 

30725 

A 

1 

100 

87 

1.63 

0.11 

0.98 

0.44 

7 

2 

30725 

B 

0 

5 

4 

-0.64 

1.21 

1.15 

-0.33 

7 

2 

30725 

C 

0 

9 

8 

0.27 

0.21 

0.58 

-0.25 

7 

2 

30725 

D 

0 

1 

1 

-1.12 

0.00 

0.12 

-0.18 

7 

3 

30511 

* 

-1 

1194 

91 

1.35 

0.04 

0.00 

-0.07 

7 

3 

30511 

A 

1 

93 

74 

1.98 

0.13 

1.09 

0.37 

7 

3 

30511 

B 

0 

13 

10 

0.59 

0.35 

0.81 

-0.29 

7 

3 

30511 

C 

0 

14 

11 

1.34 

0.16 

1.22 

-0.10 

7 

3 

30511 

D 

0 

5 

4 

0.25 

0.58 

0.60 

-0.23 

7 

4 

31210 

* 

-1 

1306 

99 

1.38 

0.04 

0.00 

-0.02 

7 

4 

31210 

A 

1 

9 

69 

2.51 

0.45 

0.63 

0.67 

7 

4 

31210 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

31210 

C 

0 

2 

15 

0.92 

0.45 

0.89 

-0.19 

7 

4 

31210 

D 

0 

2 

15 

-1.05 

1.32 

0.23 

-0.67 

7 

5 

31160 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.01 

7 

5 

31160 

A 

1 

11 

55 

2.04 

0.40 

1.23 

0.40 

7 

5 

31160 

B 

0 

2 

10 

0.66 

0.02 

0.45 

-0.22 

7 

5 

31160 

C 

0 

7 

35 

1.04 

0.57 

1.67 

-0.28 

7 

5 

31160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

30704 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.03 

7 

6 

30704 

A 

1 

8 

50 

2.97 

0.50 

0.55 

0.72 

7 

6 

30704 

B 

0 

7 

44 

0.34 

0.41 

0.49 

-0.72 

7 

6 

30704 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

30704 

D 

0 

1 

6 

1.55 

0.00 

1.01 

-0.03 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

KMD328 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

7 

7 

KMD328 

A 

1 

35 

73 

1.86 

0.20 

0.88 

0.49 

7 

7 

KMD328 

B 

0 

10 

21 

0.64 

0.32 

0.99 

-0.33 

7 

7 

KMD328 

C 

0 

3 

6 

-0.18 

0.61 

0.39 

-0.34 

7 

7 

KMD328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

8 

KCC313 

* 

-1 

1221 

93 

1.39 

0.04 

0.00 

0.03 

7 

8 

KCC313 

A 

1 

91 

93 

1.34 

0.12 

0.92 

0.30 

7 

8 

KCC313 

B 

0 

7 

7 

-0.10 

0.32 

0.54 

-0.30 

7 

8 

KCC313 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

8 

KCC313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

9 

KCClll 

* 

-1 

1268 

96 

1.40 

0.04 

0.00 

0.06 

7 

9 

KCClll 

A 

1 

42 

82 

1.04 

0.19 

1.00 

0.26 

7 

9 

KCClll 

B 

0 

7 

14 

0.23 

0.27 

0.86 

-0.23 

7 

9 

KCClll 

C 

0 

2 

4 

0.36 

0.66 

0.99 

-0.09 

7 

9 

KCClll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

10 

KOI 86 

* 

-1 

1197 

91 

1.39 

0.04 

0.00 

0.01 

7 

10 

KOI 86 

A 

1 

97 

80 

1.78 

0.11 

0.77 

0.57 

7 

10 

KOI 86 

B 

0 

12 

10 

0.12 

0.33 

0.81 

-0.28 

7 

10 

KOI 86 

C 

0 

11 

9 

0.10 

0.22 

0.50 

-0.27 

7 

10 

KOI 86 

D 

0 

2 

2 

-4.90 

0.51 

0.00 

-0.55 

7 

11 

K0039 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

7 

11 

K0039 

A 

1 

11 

69 

2.16 

0.55 

0.78 

0.52 

7 

11 

K0039 

B 

0 

1 

6 

1.09 

0.00 

1.44 

-0.07 

7 

11 

K0039 

C 

0 

3 

19 

0.00 

0.52 

0.64 

-0.43 

7 

11 

K0039 

D 

0 

1 

6 

-0.06 

0.00 

0.45 

-0.24 

7 

12 

K0449 

* 

-1 

1300 

99 

1.40 

0.04 

0.00 

0.09 

7 

12 

K0449 

A 

1 

9 

47 

1.38 

0.53 

1.33 

0.54 

7 

12 

K0449 

B 

0 

4 

21 

-0.44 

0.17 

0.39 

-0.18 

7 

12 

K0449 

C 

0 

4 

21 

-1.17 

1.51 

1.31 

-0.37 

7 

12 

K0449 

D 

0 

2 

11 

-0.71 

1.50 

0.67 

-0.16 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

K0458 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.07 

7 

13 

K0458 

A 

1 

15 

94 

2.43 

0.45 

1.24 

0.18 

7 

13 

K0458 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

13 

K0458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

13 

K0458 

D 

0 

1 

6 

1.17 

0.00 

1.13 

-0.18 

7 

14 

K0307 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

7 

14 

K0307 

A 

1 

16 

89 

2.40 

0.45 

1.08 

0.42 

7 

14 

K0307 

B 

0 

2 

11 

-0.06 

0.22 

0.44 

-0.42 

7 

14 

K0307 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

14 

K0307 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

15 

K0419 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

7 

15 

K0419 

A 

1 

16 

84 

2.09 

0.42 

1.05 

0.30 

7 

15 

K0419 

B 

0 

1 

5 

0.94 

0.00 

0.86 

-0.14 

7 

15 

K0419 

C 

0 

2 

11 

0.72 

0.04 

0.69 

-0.25 

7 

15 

K0419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

16 

K0480 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

7 

16 

K0480 

A 

1 

12 

63 

1.62 

0.32 

0.96 

0.63 

7 

16 

K0480 

B 

0 

5 

26 

-0.04 

0.49 

0.66 

-0.49 

7 

16 

K0480 

C 

0 

2 

11 

-0.01 

0.14 

0.43 

-0.28 

7 

16 

K0480 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

17 

K0332 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

7 

17 

K0332 

A 

1 

8 

47 

2.28 

0.36 

0.90 

0.43 

7 

17 

K0332 

B 

0 

1 

6 

1.10 

0.00 

0.51 

-0.15 

7 

17 

K0332 

C 

0 

5 

29 

1.34 

0.51 

1.18 

-0.24 

7 

17 

K0332 

D 

0 

3 

18 

1.29 

0.92 

1.32 

-0.19 

7 

18 

KOI 48 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

7 

18 

KOI 48 

A 

1 

18 

95 

2.24 

0.43 

0.77 

0.40 

7 

18 

KOI 48 

B 

0 

1 

5 

-1.12 

0.00 

0.17 

-0.40 

7 

18 

KOI 48 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

18 

KOI 48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

K0097 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

7 

19 

K0097 

A 

1 

15 

83 

1.91 

0.36 

0.71 

0.58 

7 

19 

K0097 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

19 

K0097 

C 

0 

1 

6 

0.33 

0.00 

0.68 

-0.14 

7 

19 

K0097 

D 

0 

2 

11 

-1.73 

2.41 

0.49 

-0.59 

7 

20 

KOI 85 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

7 

20 

KOI 85 

A 

1 

14 

82 

1.92 

0.35 

1.13 

0.37 

7 

20 

KOI 85 

B 

0 

2 

12 

0.91 

0.07 

0.75 

-0.23 

7 

20 

KOI 85 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

20 

KOI 85 

D 

0 

1 

6 

0.24 

0.00 

0.38 

-0.29 

7 

21 

K0074 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

7 

21 

K0074 

A 

1 

13 

68 

2.55 

0.48 

0.78 

0.64 

7 

21 

K0074 

B 

0 

1 

5 

1.27 

0.00 

1.40 

-0.02 

7 

21 

K0074 

C 

0 

4 

21 

-0.32 

0.91 

0.60 

-0.37 

7 

21 

K0074 

D 

0 

1 

5 

-5.12 

0.00 

0.00 

-0.63 

7 

22 

K0067 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.06 

7 

22 

K0067 

A 

1 

9 

47 

1.73 

0.50 

1.21 

0.51 

7 

22 

K0067 

B 

0 

4 

21 

-1.11 

1.36 

0.64 

-0.40 

7 

22 

K0067 

C 

0 

3 

16 

1.77 

0.17 

2.24 

0.24 

7 

22 

K0067 

D 

0 

3 

16 

-1.83 

0.75 

0.10 

-0.48 

7 

23 

KNBT15 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

7 

23 

KNBT15 

A 

1 

33 

69 

2.03 

0.19 

1.05 

0.40 

7 

23 

KNBT15 

B 

0 

10 

21 

0.95 

0.29 

0.81 

-0.37 

7 

23 

KNBT15 

C 

0 

5 

10 

1.40 

0.17 

0.93 

-0.11 

7 

23 

KNBT15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

24 

KNBT132 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

7 

24 

KNBT132 

A 

1 

27 

56 

2.06 

0.22 

1.26 

0.33 

7 

24 

KNBT132 

B 

0 

9 

19 

1.03 

0.36 

1.03 

-0.31 

7 

24 

KNBT132 

C 

0 

12 

25 

1.56 

0.20 

1.13 

-0.10 

7 

24 

KNBT132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

KNBT130 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

7 

25 

KNBT130 

A 

1 

22 

43 

1.76 

0.27 

1.71 

0.15 

7 

25 

KNBT130 

B 

0 

13 

25 

1.25 

0.30 

1.03 

-0.18 

7 

25 

KNBT130 

C 

0 

16 

31 

1.58 

0.17 

1.18 

0.00 

7 

25 

KNBT130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

30274 

* 

-1 

120S 

91 

1.40 

0.04 

0.00 

0.04 

8 

1 

30274 

A 

1 

106 

93 

1.28 

0.12 

0.91 

0.33 

8 

1 

30274 

B 

0 

2 

2 

-0.8S 

0.98 

0.3S 

-0.21 

8 

1 

30274 

C 

0 

6 

S 

-0.22 

0.43 

0.83 

-0.26 

8 

1 

30274 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

30703 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.03 

8 

2 

30703 

A 

1 

12 

80 

1.48 

0.40 

0.66 

0.64 

8 

2 

30703 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

30703 

C 

0 

2 

13 

-0.S9 

0.11 

0.43 

-0.38 

8 

2 

30703 

D 

0 

1 

7 

-2.09 

0.00 

0.09 

-O.Sl 

8 

3 

30702 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

8 

3 

30702 

A 

1 

10 

63 

2.S3 

0.70 

0.82 

0.S7 

8 

3 

30702 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

3 

30702 

C 

0 

4 

2S 

0.S2 

0.S2 

1.67 

-0.27 

8 

3 

30702 

D 

0 

2 

13 

-1.26 

0.37 

0.20 

-0.48 

8 

4 

KG51 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

8 

4 

KG51 

A 

1 

36 

71 

1.80 

0.17 

1.04 

0.32 

8 

4 

KG51 

B 

0 

8 

16 

0.73 

0.29 

0.68 

-0.34 

8 

4 

KG51 

C 

0 

7 

14 

1.39 

0.4S 

l.Sl 

-0.07 

8 

4 

KG51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

5 

KG57 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

8 

5 

KGS 7 

A 

1 

26 

SO 

1.S4 

0.18 

1.19 

0.14 

8 

5 

KGS 7 

B 

0 

21 

40 

1.43 

0.21 

1.69 

0.03 

8 

5 

KGS 7 

C 

0 

S 

10 

0.60 

0.26 

0.S3 

-0.29 

8 

5 

KGS 7 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

6 

30SS4 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

8 

6 

30SS4 

A 

1 

10 

S3 

2.S6 

0.3S 

0.72 

0.S9 

8 

6 

30SS4 

B 

0 

3 

16 

1.30 

0.9S 

1.68 

-0.19 

8 

6 

30SS4 

C 

0 

2 

11 

0.69 

0.4S 

0.41 

-0.32 

8 

6 

30SS4 

D 

0 

4 

21 

1.09 

0.41 

0.71 

-0.32 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

KMD314 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

8 

7 

KMD314 

A 

1 

36 

72 

1.31 

0.19 

0.78 

0.53 

8 

7 

KMD314 

B 

0 

11 

22 

0.07 

0.13 

0.60 

-0.39 

8 

7 

KMD314 

C 

0 

3 

6 

-0.61 

0.17 

0.30 

-0.33 

8 

7 

KMD314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

KCC42 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

8 

8 

KCC42 

A 

1 

47 

94 

1.62 

0.17 

0.95 

0.23 

8 

8 

KCC42 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

KCC42 

C 

0 

3 

6 

0.47 

0.71 

0.89 

-0.23 

8 

8 

KCC42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

9 

KCC710 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

8 

9 

KCC710 

A 

1 

46 

88 

1.51 

0.14 

0.98 

0.33 

8 

9 

KCC710 

B 

0 

1 

2 

0.42 

0.00 

0.49 

-0.15 

8 

9 

KCC710 

C 

0 

5 

10 

0.58 

0.15 

0.61 

-0.29 

8 

9 

KCC710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

10 

KCC312 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

8 

10 

KCC312 

A 

1 

38 

78 

1.30 

0.19 

1.14 

0.24 

8 

10 

KCC312 

B 

0 

8 

16 

0.73 

0.26 

1.13 

-0.17 

8 

10 

KCC312 

C 

0 

3 

6 

0.43 

0.74 

1.16 

-0.16 

8 

10 

KCC312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

11 

KOI 45 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

8 

11 

KOI 45 

A 

1 

13 

72 

1.62 

0.28 

1.00 

0.28 

8 

11 

KOI 45 

B 

0 

2 

11 

1.51 

0.26 

1.40 

0.03 

8 

11 

KOI 45 

C 

0 

2 

11 

-0.39 

0.70 

0.25 

-0.59 

8 

11 

KOI 45 

D 

0 

1 

6 

2.38 

0.00 

3.20 

0.21 

8 

12 

KCC114 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

8 

12 

KCC114 

A 

1 

34 

67 

1.89 

0.27 

1.13 

0.40 

8 

12 

KCC114 

B 

0 

10 

20 

0.72 

0.20 

0.81 

-0.25 

8 

12 

KCC114 

C 

0 

7 

14 

0.55 

0.44 

0.91 

-0.25 

8 

12 

KCC114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

K0463 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

8 

13 

K0463 

A 

1 

16 

89 

1.84 

0.34 

0.59 

0.60 

8 

13 

K0463 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

13 

K0463 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

13 

K0463 

D 

0 

2 

11 

-1.28 

1.09 

0.25 

-0.60 

8 

14 

K0443 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

8 

14 

K0443 

A 

1 

14 

78 

1.92 

0.38 

0.56 

0.76 

8 

14 

K0443 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

14 

K0443 

C 

0 

2 

11 

-2.75 

2.27 

0.36 

-0.60 

8 

14 

K0443 

D 

0 

2 

11 

-1.48 

0.18 

0.13 

-0.40 

8 

15 

K0396 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

8 

15 

K0396 

A 

1 

13 

72 

2.05 

0.43 

0.64 

0.71 

8 

15 

K0396 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

15 

K0396 

C 

0 

3 

17 

-0.27 

0.10 

0.42 

-0.26 

8 

15 

K0396 

D 

0 

2 

11 

-3.38 

1.74 

0.11 

-0.69 

8 

16 

K0387 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

8 

16 

K0387 

A 

1 

13 

68 

2.10 

0.46 

1.24 

0.55 

8 

16 

K0387 

B 

0 

2 

11 

-0.32 

0.39 

0.33 

-0.37 

8 

16 

K0387 

C 

0 

4 

21 

0.37 

0.42 

0.76 

-0.35 

8 

16 

K0387 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

17 

KMD26 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

8 

17 

KMD26 

A 

1 

20 

39 

1.71 

0.26 

1.22 

0.30 

8 

17 

KMD26 

B 

0 

9 

18 

1.01 

0.28 

0.98 

-0.10 

8 

17 

KMD26 

C 

0 

22 

43 

0.98 

0.25 

1.26 

-0.22 

8 

17 

KMD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

18 

KOI 64 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

8 

18 

KOI 64 

A 

1 

17 

94 

1.77 

0.40 

0.98 

0.26 

8 

18 

KOI 64 

B 

0 

1 

6 

-0.03 

0.00 

0.50 

-0.26 

8 

18 

KOI 64 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

18 

KOI 64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

K0161 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

8 

19 

K0161 

A 

1 

16 

89 

2.48 

0.40 

0.68 

0.50 

8 

19 

K0161 

B 

0 

1 

6 

-1.83 

0.00 

0.07 

-0.55 

8 

19 

K0161 

C 

0 

1 

6 

1.16 

0.00 

1.32 

-0.14 

8 

19 

K0161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

20 

K0037 

* 

-1 

816 

62 

1.32 

0.05 

0.00 

-0.05 

8 

20 

K0037 

A 

1 

385 

77 

2.03 

0.08 

0.99 

0.55 

8 

20 

K0037 

B 

0 

19 

4 

-0.30 

0.18 

0.41 

-0.19 

8 

20 

K0037 

C 

0 

64 

13 

0.10 

0.16 

0.80 

-0.29 

8 

20 

K0037 

D 

0 

35 

7 

-1.06 

0.31 

0.42 

-0.38 

8 

21 

KOI 34 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

8 

21 

KOI 34 

A 

1 

13 

72 

2.04 

0.29 

0.67 

0.58 

8 

21 

KOI 34 

B 

0 

1 

6 

-0.79 

0.00 

0.13 

-0.44 

8 

21 

KOI 34 

C 

0 

2 

11 

1.77 

0.00 

1.72 

0.05 

8 

21 

KOI 34 

D 

0 

2 

11 

-0.45 

0.56 

0.22 

-0.55 

8 

22 

K0025 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

8 

22 

K0025 

A 

1 

12 

63 

2.45 

0.35 

0.80 

0.59 

8 

22 

K0025 

B 

0 

3 

16 

0.93 

0.91 

1.10 

-0.20 

8 

22 

K0025 

C 

0 

2 

11 

0.31 

0.86 

0.43 

-0.29 

8 

22 

K0025 

D 

0 

2 

11 

-0.26 

2.11 

0.74 

-0.41 

8 

23 

KNBT138 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

8 

23 

KNBT138 

A 

1 

36 

73 

1.82 

0.20 

0.98 

0.32 

8 

23 

KNBT138 

B 

0 

5 

10 

1.47 

0.36 

1.51 

-0.04 

8 

23 

KNBT138 

C 

0 

8 

16 

0.68 

0.25 

0.65 

-0.34 

8 

23 

KNBT138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

24 

KNBT153 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

8 

24 

KNBT153 

A 

1 

25 

49 

1.85 

0.20 

1.02 

0.46 

8 

24 

KNBT153 

B 

0 

14 

27 

1.05 

0.12 

0.78 

-0.25 

8 

24 

KNBT153 

C 

0 

12 

24 

0.97 

0.22 

0.82 

-0.27 

8 

24 

KNBT153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

KNBT197 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.03 

8 

25 

KNBT197 

A 

1 

14 

29 

2.68 

0.39 

0.74 

0.60 

8 

25 

KNBT197 

B 

0 

9 

19 

0.77 

0.17 

0.48 

-0.33 

8 

25 

KNBT197 

C 

0 

25 

52 

1.25 

0.14 

0.82 

-0.29 

8 

25 

KNBT197 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

K0538 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

9 

1 

K0538 

A 

1 

16 

94 

1.81 

0.36 

0.95 

0.36 

9 

1 

K0538 

B 

0 

1 

6 

-0.46 

0.00 

0.30 

-0.36 

9 

1 

K0538 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

1 

K0538 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

2 

KG517 

* 

-1 

1219 

92 

1.42 

0.04 

0.00 

0.09 

9 

2 

KG517 

A 

1 

83 

83 

1.14 

0.12 

0.86 

0.42 

9 

2 

KG517 

B 

0 

9 

9 

0.15 

0.26 

0.85 

-0.21 

9 

2 

KG517 

C 

0 

8 

8 

-0.50 

0.28 

0.43 

-0.36 

9 

2 

KG517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

3 

K0522 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

9 

3 

K0522 

A 

1 

12 

67 

1.66 

0.41 

1.04 

0.41 

9 

3 

K0522 

B 

0 

2 

11 

0.11 

0.03 

0.43 

-0.34 

9 

3 

K0522 

C 

0 

4 

22 

0.82 

0.21 

0.93 

-0.21 

9 

3 

K0522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

KG528 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

9 

4 

KG528 

A 

1 

38 

73 

2.10 

0.19 

1.11 

0.37 

9 

4 

KG528 

B 

0 

9 

17 

0.86 

0.26 

0.66 

-0.38 

9 

4 

KG528 

C 

0 

5 

10 

1.56 

0.33 

1.24 

-0.08 

9 

4 

KG528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

5 

KG526 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

9 

5 

KG526 

A 

1 

29 

60 

2.12 

0.20 

1.10 

0.43 

9 

5 

KG526 

B 

0 

8 

17 

1.25 

0.35 

1.07 

-0.20 

9 

5 

KG526 

C 

0 

11 

23 

1.10 

0.24 

0.85 

-0.32 

9 

5 

KG526 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

6 

31018 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.06 

9 

6 

31018 

A 

1 

5 

26 

1.68 

0.93 

1.41 

0.38 

9 

6 

31018 

B 

0 

6 

32 

0.87 

0.37 

1.50 

0.10 

9 

6 

31018 

C 

0 

6 

32 

-0.22 

0.71 

0.95 

-0.36 

9 

6 

31018 

D 

0 

2 

11 

-0.06 

1.07 

0.69 

-0.15 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

KMD319 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

9 

7 

KMD319 

A 

1 

33 

69 

1.35 

0.15 

0.89 

0.48 

9 

7 

KMD319 

B 

0 

11 

23 

0.34 

0.27 

0.84 

-0.41 

9 

7 

KMD319 

C 

0 

4 

8 

0.45 

0.28 

0.72 

-0.19 

9 

7 

KMD319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

8 

KOI 52 

* 

-1 

1203 

91 

1.37 

0.04 

0.00 

-0.03 

9 

8 

KOI 52 

A 

1 

108 

93 

1.63 

0.13 

0.94 

0.34 

9 

8 

KOI 52 

B 

0 

5 

4 

-0.35 

0.25 

0.33 

-0.29 

9 

8 

KOI 52 

C 

0 

3 

3 

0.14 

0.09 

0.48 

-0.17 

9 

8 

KOI 52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

9 

KCC318 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

9 

9 

KCC318 

A 

1 

41 

82 

1.06 

0.19 

0.98 

0.25 

9 

9 

KCC318 

B 

0 

4 

8 

0.26 

0.52 

1.10 

-0.17 

9 

9 

KCC318 

C 

0 

5 

10 

0.31 

0.36 

0.95 

-0.18 

9 

9 

KCC318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

10 

KCC320 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

9 

10 

KCC320 

A 

1 

38 

76 

1.11 

0.12 

0.90 

0.40 

9 

10 

KCC320 

B 

0 

2 

4 

0.78 

0.65 

1.22 

-0.04 

9 

10 

KCC320 

C 

0 

10 

20 

0.27 

0.28 

0.82 

-0.40 

9 

10 

KCC320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

11 

KCC713 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

9 

11 

KCC713 

A 

1 

36 

72 

1.81 

0.21 

1.08 

0.34 

9 

11 

KCC713 

B 

0 

9 

18 

0.67 

0.21 

0.65 

-0.34 

9 

11 

KCC713 

C 

0 

5 

10 

1.32 

0.27 

1.25 

-0.07 

9 

11 

KCC713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

12 

KCC719 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

9 

12 

KCC719 

A 

1 

30 

63 

1.52 

0.21 

0.94 

0.42 

9 

12 

KCC719 

B 

0 

7 

15 

0.69 

0.41 

1.15 

-0.17 

9 

12 

KCC719 

C 

0 

11 

23 

0.42 

0.19 

0.68 

-0.35 

9 

12 

KCC719 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

K0369 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

9 

13 

K0369 

A 

1 

16 

84 

1.71 

0.41 

0.60 

0.62 

9 

13 

K0369 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

13 

K0369 

C 

0 

1 

5 

-0.88 

0.00 

0.35 

-0.26 

9 

13 

K0369 

D 

0 

2 

11 

-1.75 

0.61 

0.18 

-0.55 

9 

14 

KMDlll 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

9 

14 

KMDlll 

A 

1 

41 

85 

1.28 

0.18 

0.97 

0.29 

9 

14 

KMDlll 

B 

0 

4 

8 

0.07 

0.51 

0.72 

-0.29 

9 

14 

KMDlll 

C 

0 

3 

6 

0.76 

0.61 

1.41 

-0.09 

9 

14 

KMDlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

15 

30289 

* 

-1 

818 

62 

1.31 

0.05 

0.00 

-0.06 

9 

15 

30289 

A 

1 

395 

79 

1.93 

0.08 

1.13 

0.46 

9 

15 

30289 

B 

0 

32 

6 

0.16 

0.13 

0.71 

-0.19 

9 

15 

30289 

C 

0 

33 

7 

0.10 

0.36 

1.72 

-0.21 

9 

15 

30289 

D 

0 

41 

8 

-0.50 

0.28 

0.79 

-0.33 

9 

16 

K0486 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

9 

16 

K0486 

A 

1 

12 

71 

2.49 

0.49 

0.60 

0.61 

9 

16 

K0486 

B 

0 

1 

6 

2.11 

0.00 

3.58 

0.05 

9 

16 

K0486 

C 

0 

3 

18 

-0.76 

0.88 

0.35 

-0.55 

9 

16 

K0486 

D 

0 

1 

6 

-1.14 

0.00 

0.14 

-0.35 

9 

17 

K0445 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.02 

9 

17 

K0445 

A 

1 

7 

41 

1.88 

0.66 

1.19 

0.45 

9 

17 

K0445 

B 

0 

2 

12 

1.60 

0.15 

1.86 

0.13 

9 

17 

K0445 

C 

0 

4 

24 

0.49 

0.17 

0.64 

-0.21 

9 

17 

K0445 

D 

0 

4 

24 

-0.04 

0.83 

0.83 

-0.41 

9 

18 

KOI 15 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

9 

18 

K0115 

A 

1 

17 

94 

1.62 

0.31 

0.82 

0.42 

9 

18 

K0115 

B 

0 

1 

6 

-0.76 

0.00 

0.20 

-0.42 

9 

18 

KOI 15 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

18 

K0115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

K0080 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

9 

19 

K0080 

A 

1 

15 

88 

2.34 

0.41 

0.71 

0.52 

9 

19 

K0080 

B 

0 

1 

6 

-1.06 

0.00 

0.13 

-0.46 

9 

19 

K0080 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

19 

K0080 

D 

0 

1 

6 

0.25 

0.00 

0.49 

-0.26 

9 

20 

KOI 14 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

9 

20 

KOI 14 

A 

1 

14 

78 

2.14 

0.51 

1.09 

0.42 

9 

20 

KOI 14 

B 

0 

3 

17 

0.58 

0.26 

0.82 

-0.29 

9 

20 

KOI 14 

C 

0 

1 

6 

-0.51 

0.00 

0.26 

-0.30 

9 

20 

KOI 14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

21 

KOI 23 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

9 

21 

KOI 23 

A 

1 

13 

72 

2.59 

0.52 

0.83 

0.53 

9 

21 

KOI 23 

B 

0 

3 

17 

0.56 

0.65 

1.02 

-0.35 

9 

21 

KOI 23 

C 

0 

1 

6 

0.26 

0.00 

0.50 

-0.23 

9 

21 

KOI 23 

D 

0 

1 

6 

0.16 

0.00 

0.45 

-0.24 

9 

22 

KOI 73 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

9 

22 

KOI 73 

A 

1 

11 

58 

2.93 

0.62 

1.01 

0.63 

9 

22 

KOI 73 

B 

0 

7 

37 

0.45 

0.37 

1.12 

-0.51 

9 

22 

KOI 73 

C 

0 

1 

5 

-0.71 

0.00 

0.23 

-0.29 

9 

22 

KOI 73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

23 

KNBT141 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

9 

23 

KNBT141 

A 

1 

31 

65 

1.18 

0.15 

1.03 

0.35 

9 

23 

KNBT141 

B 

0 

12 

25 

0.69 

0.11 

0.86 

-0.21 

9 

23 

KNBT141 

C 

0 

5 

10 

0.42 

0.38 

0.79 

-0.25 

9 

23 

KNBT141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

24 

KNBT119 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

9 

24 

KNBT119 

A 

1 

29 

56 

2.27 

0.20 

0.92 

0.42 

9 

24 

KNBT119 

B 

0 

19 

37 

1.35 

0.26 

1.50 

-0.31 

9 

24 

KNBT119 

C 

0 

4 

8 

0.97 

0.34 

0.56 

-0.21 

9 

24 

KNBT119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

KNBTll 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

9 

25 

KNBTll 

A 

1 

22 

45 

1.97 

0.29 

1.24 

0.29 

9 

25 

KNBTll 

B 

0 

2 

4 

0.54 

0.44 

0.41 

-0.19 

9 

25 

KNBTll 

C 

0 

25 

51 

1.36 

0.19 

1.51 

-0.21 

9 

25 

KNBTll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

30403 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

10 

1 

30403 

A 

1 

15 

83 

1.47 

0.48 

0.79 

0.63 

10 

1 

30403 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

1 

30403 

C 

0 

1 

6 

-0.47 

0.00 

0.64 

-0.14 

10 

1 

30403 

D 

0 

2 

11 

-3.34 

1.24 

0.13 

-0.64 

10 

2 

30266 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

10 

2 

30266 

A 

1 

15 

83 

1.46 

0.37 

0.84 

0.40 

10 

2 

30266 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

2 

30266 

C 

0 

1 

6 

-1.03 

0.00 

0.21 

-0.36 

10 

2 

30266 

D 

0 

2 

11 

0.32 

1.45 

1.84 

-0.21 

10 

3 

KG321 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

10 

3 

KG321 

A 

1 

34 

67 

1.62 

0.18 

0.94 

0.42 

10 

3 

KG321 

B 

0 

4 

8 

1.31 

0.63 

2.09 

0.01 

10 

3 

KG321 

C 

0 

13 

25 

0.36 

0.26 

0.66 

-0.46 

10 

3 

KG321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

30716 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.04 

10 

4 

30716 

A 

1 

10 

71 

2.39 

0.52 

1.05 

0.47 

10 

4 

30716 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

30716 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

30716 

D 

0 

4 

29 

0.74 

0.46 

0.74 

-0.47 

10 

5 

31025 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.03 

10 

5 

31025 

A 

1 

9 

43 

2.01 

0.57 

0.86 

0.49 

10 

5 

31025 

B 

0 

3 

14 

-0.95 

1.12 

0.34 

-0.43 

10 

5 

31025 

C 

0 

6 

29 

1.30 

0.46 

2.44 

0.11 

10 

5 

31025 

D 

0 

3 

14 

-0.89 

0.71 

0.24 

-0.41 

10 

6 

31012 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

10 

6 

31012 

A 

1 

8 

47 

2.64 

0.71 

1.39 

0.46 

10 

6 

31012 

B 

0 

3 

18 

1.52 

0.34 

1.17 

-0.08 

10 

6 

31012 

C 

0 

4 

24 

1.00 

0.62 

1.00 

-0.26 

10 

6 

31012 

D 

0 

2 

12 

0.43 

1.56 

0.88 

-0.29 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

K0382 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

10 

7 

K0382 

A 

1 

14 

74 

2.42 

0.57 

1.54 

0.55 

10 

7 

K0382 

B 

0 

3 

16 

0.10 

0.44 

0.74 

-0.26 

10 

7 

K0382 

C 

0 

1 

5 

1.31 

0.00 

2.00 

-0.03 

10 

7 

K0382 

D 

0 

1 

5 

-5.05 

0.00 

0.00 

-0.62 

10 

8 

K0013 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

10 

8 

K0013 

A 

1 

15 

83 

1.75 

0.38 

0.56 

0.76 

10 

8 

K0013 

B 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

10 

8 

K0013 

C 

0 

1 

6 

-1.06 

0.00 

0.25 

-0.22 

10 

8 

K0013 

D 

0 

1 

6 

-2.36 

0.00 

0.07 

-0.36 

10 

9 

KOI 82 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

10 

9 

KOI 82 

A 

1 

15 

83 

1.90 

0.42 

0.71 

0.55 

10 

9 

KOI 82 

B 

0 

1 

6 

0.07 

0.00 

0.67 

-0.19 

10 

9 

KOI 82 

C 

0 

1 

6 

-0.19 

0.00 

0.52 

-0.22 

10 

9 

KOI 82 

D 

0 

1 

6 

-2.21 

0.00 

0.07 

-0.49 

10 

10 

KCC321 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

10 

10 

KCC321 

A 

1 

38 

78 

1.24 

0.16 

1.05 

0.25 

10 

10 

KCC321 

B 

0 

6 

12 

0.46 

0.41 

0.94 

-0.24 

10 

10 

KCC321 

C 

0 

5 

10 

0.82 

0.37 

1.34 

-0.09 

10 

10 

KCC321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

11 

KCC24 

* 

-1 

1267 

96 

1.39 

0.04 

0.00 

0.01 

10 

11 

KCC24 

A 

1 

35 

67 

1.48 

0.20 

1.29 

0.25 

10 

11 

KCC24 

B 

0 

8 

15 

0.75 

0.33 

0.96 

-0.20 

10 

11 

KCC24 

C 

0 

9 

17 

0.97 

0.35 

1.35 

-0.12 

10 

11 

KCC24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

12 

K0423 

* 

-1 

1198 

91 

1.39 

0.04 

0.00 

0.00 

10 

12 

K0423 

A 

1 

81 

67 

1.85 

0.12 

0.81 

0.51 

10 

12 

K0423 

B 

0 

10 

8 

0.55 

0.24 

0.72 

-0.18 

10 

12 

K0423 

C 

0 

26 

21 

0.73 

0.22 

1.28 

-0.24 

10 

12 

K0423 

D 

0 

4 

3 

-2.43 

0.41 

0.04 

-0.52 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

K0352 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

10 

13 

K0352 

A 

1 

16 

89 

1.43 

0.29 

0.83 

0.50 

10 

13 

K0352 

B 

0 

1 

6 

-0.11 

0.00 

0.44 

-0.26 

10 

13 

K0352 

C 

0 

1 

6 

-0.88 

0.00 

0.20 

-0.42 

10 

13 

K0352 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

14 

K0386 

* 

-1 

1203 

91 

1.37 

0.04 

0.00 

-0.02 

10 

14 

K0386 

A 

1 

101 

87 

1.61 

0.13 

1.03 

0.26 

10 

14 

K0386 

B 

0 

5 

4 

1.23 

0.36 

1.81 

-0.04 

10 

14 

K0386 

C 

0 

9 

8 

0.55 

0.33 

0.97 

-0.20 

10 

14 

K0386 

D 

0 

1 

1 

-2.24 

0.00 

0.04 

-0.26 

10 

15 

K0427 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

10 

15 

K0427 

A 

1 

15 

83 

1.87 

0.36 

0.88 

0.41 

10 

15 

K0427 

B 

0 

2 

11 

0.64 

0.57 

0.74 

-0.26 

10 

15 

K0427 

C 

0 

1 

6 

-0.11 

0.00 

0.30 

-0.31 

10 

15 

K0427 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

16 

K0329 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

10 

16 

K0329 

A 

1 

13 

68 

1.69 

0.43 

1.67 

0.34 

10 

16 

K0329 

B 

0 

6 

32 

0.71 

0.21 

0.81 

-0.34 

10 

16 

K0329 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

16 

K0329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

17 

K0444 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

10 

17 

K0444 

A 

1 

9 

50 

2.46 

0.62 

1.15 

0.51 

10 

17 

K0444 

B 

0 

4 

22 

0.32 

0.23 

0.51 

-0.35 

10 

17 

K0444 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

17 

K0444 

D 

0 

5 

28 

0.83 

0.88 

1.82 

-0.24 

10 

18 

KOI 06 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

10 

18 

KOI 06 

A 

1 

16 

94 

1.88 

0.41 

0.97 

0.29 

10 

18 

KOI 06 

B 

0 

1 

6 

-0.15 

0.00 

0.40 

-0.29 

10 

18 

KOI 06 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

18 

KOI 06 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


134 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

KOI 78 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

10 

19 

K0178 

A 

1 

15 

83 

2.17 

0.38 

1.03 

0.65 

10 

19 

K0178 

B 

0 

1 

6 

0.19 

0.00 

0.40 

-0.17 

10 

19 

KOI 78 

C 

0 

1 

6 

-0.03 

0.00 

0.32 

-0.20 

10 

19 

K0178 

D 

0 

1 

6 

-4.07 

0.00 

0.00 

-0.69 

10 

20 

K0113 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

10 

20 

K0113 

A 

1 

15 

75 

2.12 

0.42 

0.71 

0.58 

10 

20 

K0113 

B 

0 

1 

5 

0.54 

0.00 

0.84 

-0.10 

10 

20 

KOI 13 

C 

0 

1 

5 

1.41 

0.00 

2.02 

0.00 

10 

20 

KOI 13 

D 

0 

3 

15 

-1.77 

1.23 

0.21 

-0.65 

10 

21 

KOlOl 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

10 

21 

KOlOl 

A 

1 

10 

59 

2.14 

0.48 

0.63 

0.68 

10 

21 

KOlOl 

B 

0 

1 

6 

-1.12 

0.00 

0.17 

-0.21 

10 

21 

KOlOl 

C 

0 

5 

29 

-0.21 

0.59 

0.73 

-0.28 

10 

21 

KOlOl 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.67 

10 

22 

KOI 76 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

10 

22 

KOI 76 

A 

1 

8 

44 

1.73 

0.61 

1.22 

0.51 

10 

22 

KOI 76 

B 

0 

7 

39 

0.50 

0.32 

1.10 

-0.23 

10 

22 

KOI 76 

C 

0 

3 

17 

-0.34 

0.26 

0.37 

-0.39 

10 

22 

KOI 76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

23 

KNBT117 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

10 

23 

KNBT117 

A 

1 

31 

61 

1.63 

0.20 

0.99 

0.38 

10 

23 

KNBT117 

B 

0 

1 

2 

1.72 

0.00 

1.79 

0.06 

10 

23 

KNBT117 

C 

0 

19 

37 

0.67 

0.24 

0.97 

-0.40 

10 

23 

KNBT117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

24 

KNBT126 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

10 

24 

KNBT126 

A 

1 

19 

38 

1.36 

0.32 

1.39 

0.31 

10 

24 

KNBT126 

B 

0 

14 

28 

0.67 

0.22 

0.93 

-0.13 

10 

24 

KNBT126 

C 

0 

17 

34 

0.62 

0.24 

0.98 

-0.19 

10 

24 

KNBT126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

KNBT171 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

-0.01 

10 

25 

KNBT171 

A 

1 

44 

44 

1.75 

0.20 

1.62 

0.21 

10 

25 

KNBT171 

B 

0 

44 

44 

1.39 

0.13 

1.26 

-0.05 

10 

25 

KNBT171 

C 

0 

12 

12 

0.65 

0.47 

1.06 

-0.25 

10 

25 

KNBT171 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

K0397 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

BMF 

1 

K0397 

A 

1 

16 

89 

1.64 

0.40 

1.02 

0.55 

BMF 

1 

K0397 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

1 

K0397 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

1 

K0397 

D 

0 

2 

11 

-1.77 

2.29 

0.78 

-0.55 

BMF 

2 

KG322 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

BMF 

2 

KG322 

A 

1 

44 

90 

1.86 

0.16 

0.81 

0.49 

BMF 

2 

KG322 

B 

0 

4 

8 

-0.29 

0.79 

0.47 

-0.47 

BMF 

2 

KG322 

C 

0 

1 

2 

0.50 

0.00 

0.53 

-0.14 

BMF 

2 

KG322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

KG31 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

BMF 

3 

KG31 

A 

1 

40 

77 

2.06 

0.18 

1.02 

0.36 

BMF 

3 

KG31 

B 

0 

8 

15 

1.03 

0.38 

1.05 

-0.29 

BMF 

3 

KG31 

C 

0 

4 

8 

1.14 

0.24 

0.75 

-0.17 

BMF 

3 

KG31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

KG530 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

BMF 

4 

KG530 

A 

1 

35 

67 

1.71 

0.15 

0.88 

0.48 

BMF 

4 

KG530 

B 

0 

11 

21 

0.83 

0.21 

0.84 

-0.32 

BMF 

4 

KG530 

C 

0 

6 

12 

0.65 

0.27 

0.63 

-0.30 

BMF 

4 

KG530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

KG332 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMF 

5 

KG332 

A 

1 

25 

51 

2.12 

0.33 

1.15 

0.43 

BMF 

5 

KG332 

B 

0 

18 

37 

0.82 

0.21 

0.95 

-0.34 

BMF 

5 

KG332 

C 

0 

6 

12 

0.91 

0.53 

1.03 

-0.15 

BMF 

5 

KG332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

KG335 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

BMF 

6 

KG335 

A 

1 

19 

40 

1.62 

0.31 

1.25 

0.34 

BMF 

6 

KG335 

B 

0 

11 

23 

1.06 

0.27 

1.29 

-0.04 

BMF 

6 

KG335 

C 

0 

18 

38 

0.70 

0.20 

0.91 

-0.31 

BMF 

6 

KG335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

7 

KMD325 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

BMF 

7 

KMD325 

A 

1 

37 

76 

1.37 

0.18 

0.95 

0.34 

BMF 

7 

KMD325 

B 

0 

8 

16 

0.91 

0.38 

1.57 

-0.10 

BMF 

7 

KMD325 

C 

0 

4 

8 

-0.36 

0.23 

0.32 

-0.40 

BMF 

7 

KMD325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

8 

KCC510 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

BMF 

8 

KCC510 

A 

1 

45 

90 

1.00 

0.12 

1.05 

0.24 

BMF 

8 

KCC510 

B 

0 

1 

2 

0.47 

0.00 

0.81 

-0.08 

BMF 

8 

KCC510 

C 

0 

4 

8 

0.31 

0.29 

0.76 

-0.23 

BMF 

8 

KCC510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

9 

KCC22 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.02 

BMF 

9 

KCC22 

A 

1 

42 

84 

1.45 

0.16 

0.80 

0.46 

BMF 

9 

KCC22 

B 

0 

3 

6 

-0.43 

0.11 

0.29 

-0.35 

BMF 

9 

KCC22 

C 

0 

5 

10 

0.22 

0.56 

1.11 

-0.28 

BMF 

9 

KCC22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

10 

KCC716 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMF 

10 

KCC716 

A 

1 

40 

82 

1.81 

0.23 

0.85 

0.45 

BMF 

10 

KCC716 

B 

0 

6 

12 

-0.05 

0.38 

0.50 

-0.39 

BMF 

10 

KCC716 

C 

0 

3 

6 

0.37 

0.55 

0.74 

-0.19 

BMF 

10 

KCC716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

KCC15 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.02 

BMF 

11 

KCC15 

A 

1 

39 

76 

1.74 

0.20 

1.07 

0.28 

BMF 

11 

KCC15 

B 

0 

4 

8 

0.59 

0.35 

0.61 

-0.24 

BMF 

11 

KCC15 

C 

0 

8 

16 

1.15 

0.30 

1.24 

-0.15 

BMF 

11 

KCC15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

12 

KCC319 

* 

-1 

1267 

96 

1.40 

0.04 

0.00 

0.06 

BMF 

12 

KCC319 

A 

1 

30 

58 

1.26 

0.20 

0.99 

0.36 

BMF 

12 

KCC319 

B 

0 

10 

19 

0.05 

0.35 

0.82 

-0.35 

BMF 

12 

KCC319 

C 

0 

12 

23 

0.72 

0.32 

1.74 

-0.08 

BMF 

12 

KCC319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

13 

K0375 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

BMF 

13 

K0375 

A 

1 

16 

84 

1.77 

0.50 

0.83 

0.47 

BMF 

13 

K0375 

B 

0 

1 

5 

-1.83 

0.00 

0.14 

-0.37 

BMF 

13 

K0375 

C 

0 

2 

11 

-0.39 

0.36 

0.64 

-0.29 

BMF 

13 

K0375 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

14 

K0481 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

BMF 

14 

K0481 

A 

1 

16 

84 

1.63 

0.40 

0.83 

0.46 

BMF 

14 

K0481 

B 

0 

2 

11 

-0.57 

0.55 

0.38 

-0.39 

BMF 

14 

K0481 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

14 

K0481 

D 

0 

1 

5 

-0.20 

0.00 

0.47 

-0.22 

BMF 

15 

K0498 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

BMF 

15 

K0498 

A 

1 

15 

83 

2.11 

0.39 

0.83 

0.43 

BMF 

15 

K0498 

B 

0 

1 

6 

-0.56 

0.00 

0.19 

-0.38 

BMF 

15 

K0498 

C 

0 

2 

11 

0.80 

0.61 

0.87 

-0.24 

BMF 

15 

K0498 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

K0376 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMF 

16 

K0376 

A 

1 

13 

72 

2.43 

0.42 

0.69 

0.66 

BMF 

16 

K0376 

B 

0 

2 

11 

0.61 

0.54 

0.77 

-0.21 

BMF 

16 

K0376 

C 

0 

1 

6 

-2.49 

0.00 

0.03 

-0.55 

BMF 

16 

K0376 

D 

0 

2 

11 

-0.02 

0.18 

0.36 

-0.33 

BMF 

17 

K0328 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

BMF 

17 

K0328 

A 

1 

8 

42 

2.91 

0.69 

1.00 

0.72 

BMF 

17 

K0328 

B 

0 

6 

32 

0.28 

0.23 

0.67 

-0.32 

BMF 

17 

K0328 

C 

0 

3 

16 

-0.43 

0.65 

0.41 

-0.35 

BMF 

17 

K0328 

D 

0 

2 

11 

-0.31 

1.62 

0.85 

-0.26 

BMF 

18 

K0087 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

BMF 

18 

K0087 

A 

1 

17 

94 

2.14 

0.36 

1.03 

0.32 

BMF 

18 

K0087 

B 

0 

1 

6 

0.06 

0.00 

0.37 

-0.32 

BMF 

18 

K0087 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

18 

K0087 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

19 

KOI 26 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

BMF 

19 

KOI 26 

A 

1 

16 

84 

1.86 

0.40 

0.87 

0.36 

BMF 

19 

KOI 26 

B 

0 

2 

11 

0.35 

1.23 

1.11 

-0.27 

BMF 

19 

KOI 26 

C 

0 

1 

5 

0.17 

0.00 

0.50 

-0.21 

BMF 

19 

KOI 26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

20 

KOI 63 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

BMF 

20 

KOI 63 

A 

1 

15 

83 

2.56 

0.42 

1.03 

0.50 

BMF 

20 

KOI 63 

B 

0 

3 

17 

0.25 

0.78 

0.63 

-0.50 

BMF 

20 

KOI 63 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

20 

KOI 63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

K0136 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMF 

21 

K0136 

A 

1 

13 

72 

2.19 

0.45 

0.99 

0.50 

BMF 

21 

K0136 

B 

0 

3 

17 

0.08 

0.16 

0.38 

-0.46 

BMF 

21 

K0136 

C 

0 

2 

11 

0.98 

0.26 

0.94 

-0.16 

BMF 

21 

K0136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

22 

K0020 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

BMF 

22 

K0020 

A 

1 

10 

59 

2.34 

0.38 

0.65 

0.61 

BMF 

22 

K0020 

B 

0 

1 

6 

0.72 

0.00 

0.52 

-0.14 

BMF 

22 

K0020 

C 

0 

4 

24 

1.05 

0.43 

0.94 

-0.19 

BMF 

22 

K0020 

D 

0 

2 

12 

-0.81 

1.56 

0.28 

-0.57 

BMF 

23 

KNBT154 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

BMF 

23 

KNBT154 

A 

1 

31 

65 

2.00 

0.20 

0.89 

0.56 

BMF 

23 

KNBT154 

B 

0 

10 

21 

0.83 

0.35 

1.19 

-0.26 

BMF 

23 

KNBT154 

C 

0 

7 

15 

0.08 

0.24 

0.36 

-0.45 

BMF 

23 

KNBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

24 

KNBTllOO 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

BMF 

24 

KNBTllOO 

A 

1 

22 

44 

1.45 

0.28 

1.47 

0.42 

BMF 

24 

KNBTllOO 

B 

0 

6 

12 

0.45 

0.43 

0.91 

-0.15 

BMF 

24 

KNBTllOO 

C 

0 

22 

44 

0.51 

0.17 

0.88 

-0.32 

BMF 

24 

KNBTllOO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

25 

KNBT114 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

BMF 

25 

KNBT114 

A 

1 

10 

21 

1.78 

0.53 

1.19 

0.29 

BMF 

25 

KNBT114 

B 

0 

7 

15 

1.31 

0.39 

1.48 

0.06 

BMF 

25 

KNBT114 

C 

0 

31 

65 

0.90 

0.16 

0.98 

-0.29 

BMF 

25 

KNBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

10083 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMF 

26 

10083 

A 

1 

21 

88 

1.41 

0.36 

1.10 

0.21 

BMF 

26 

10083 

B 

0 

1 

4 

1.65 

0.00 

2.95 

0.05 

BMF 

26 

10083 

C 

0 

2 

8 

-0.21 

0.25 

0.47 

-0.29 

BMF 

26 

10083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

27 

1MD226 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

BMF 

27 

1MD226 

A 

1 

137 

88 

1.73 

0.09 

1.02 

0.23 

BMF 

27 

1MD226 

B 

0 

8 

5 

1.18 

0.24 

1.11 

-0.10 

BMF 

27 

1MD226 

C 

0 

10 

6 

0.86 

0.29 

0.90 

-0.20 

BMF 

27 

1MD226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

28 

1NBT58 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

28 

1NBT58 

A 

1 

65 

81 

1.95 

0.13 

0.82 

0.52 

BMF 

28 

1NBT58 

B 

0 

8 

10 

0.37 

0.23 

0.48 

-0.36 

BMF 

28 

1NBT58 

C 

0 

7 

9 

0.34 

0.41 

0.62 

-0.34 

BMF 

28 

1NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

29 

1NBT528 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMF 

29 

1NBT528 

A 

1 

43 

61 

2.18 

0.17 

1.05 

0.40 

BMF 

29 

1NBT528 

B 

0 

16 

23 

1.16 

0.24 

0.94 

-0.30 

BMF 

29 

1NBT528 

C 

0 

11 

16 

1.30 

0.36 

1.44 

-0.19 

BMF 

29 

1NBT528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

1MD231 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

30 

1MD231 

A 

1 

39 

49 

2.24 

0.18 

0.96 

0.48 

BMF 

30 

1MD231 

B 

0 

13 

16 

1.47 

0.36 

1.49 

-0.07 

BMF 

30 

1MD231 

C 

0 

28 

35 

0.91 

0.14 

0.63 

-0.46 

BMF 

30 

1MD231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

30127 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

BMW 

1 

30127 

A 

1 

18 

95 

1.83 

0.40 

0.94 

0.32 

BMW 

1 

30127 

B 

0 

1 

5 

-0.64 

0.00 

0.31 

-0.32 

BMW 

1 

30127 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

1 

30127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

KG322 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

BMW 

2 

KG322 

A 

1 

44 

90 

1.86 

0.16 

0.81 

0.49 

BMW 

2 

KG322 

B 

0 

4 

8 

-0.29 

0.79 

0.47 

-0.47 

BMW 

2 

KG322 

C 

0 

1 

2 

0.50 

0.00 

0.53 

-0.14 

BMW 

2 

KG322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

KG31 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

BMW 

3 

KG31 

A 

1 

40 

77 

2.06 

0.18 

1.02 

0.36 

BMW 

3 

KG31 

B 

0 

8 

15 

1.03 

0.38 

1.05 

-0.29 

BMW 

3 

KG31 

C 

0 

4 

8 

1.14 

0.24 

0.75 

-0.17 

BMW 

3 

KG31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

4 

KG530 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

BMW 

4 

KG530 

A 

1 

35 

67 

1.71 

0.15 

0.88 

0.48 

BMW 

4 

KG530 

B 

0 

11 

21 

0.83 

0.21 

0.84 

-0.32 

BMW 

4 

KG530 

C 

0 

6 

12 

0.65 

0.27 

0.63 

-0.30 

BMW 

4 

KG530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

KG37 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

BMW 

5 

KG37 

A 

1 

20 

40 

1.36 

0.34 

1.23 

0.31 

BMW 

5 

KG37 

B 

0 

15 

30 

0.72 

0.21 

1.19 

-0.11 

BMW 

5 

KG37 

C 

0 

15 

30 

0.53 

0.20 

0.92 

-0.22 

BMW 

5 

KG37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

6 

KG340 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

BMW 

6 

KG340 

A 

1 

19 

39 

1.70 

0.26 

1.08 

0.39 

BMW 

6 

KG340 

B 

0 

12 

24 

1.14 

0.34 

1.73 

-0.01 

BMW 

6 

KG340 

C 

0 

18 

37 

0.58 

0.20 

0.75 

-0.38 

BMW 

6 

KG340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

7 

KMD342 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

BMW 

7 

KMD342 

A 

1 

38 

79 

1.76 

0.19 

0.89 

0.44 

BMW 

7 

KMD342 

B 

0 

5 

10 

0.06 

0.41 

0.50 

-0.38 

BMW 

7 

KMD342 

C 

0 

5 

10 

0.72 

0.65 

1.77 

-0.20 

BMW 

7 

KMD342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

8 

K0158 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

BMW 

8 

K0158 

A 

1 

16 

94 

1.96 

0.37 

1.05 

0.19 

BMW 

8 

K0158 

B 

0 

1 

6 

0.80 

0.00 

0.75 

-0.19 

BMW 

8 

K0158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

8 

K0158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

9 

KCC58 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

BMW 

9 

KCC58 

A 

1 

40 

83 

1.33 

0.17 

0.91 

0.35 

BMW 

9 

KCC58 

B 

0 

3 

6 

0.28 

0.50 

0.74 

-0.20 

BMW 

9 

KCC58 

C 

0 

5 

10 

0.22 

0.56 

1.13 

-0.28 

BMW 

9 

KCC58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

10 

KCC38 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

BMW 

10 

KCC38 

A 

1 

39 

83 

1.61 

0.19 

0.96 

0.31 

BMW 

10 

KCC38 

B 

0 

5 

11 

0.66 

0.31 

0.82 

-0.23 

BMW 

10 

KCC38 

C 

0 

3 

6 

0.64 

0.94 

1.48 

-0.18 

BMW 

10 

KCC38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

11 

KCC44 

* 

-1 

1268 

96 

1.40 

0.04 

0.00 

0.07 

BMW 

11 

KCC44 

A 

1 

33 

65 

1.25 

0.20 

0.94 

0.44 

BMW 

11 

KCC44 

B 

0 

10 

20 

0.16 

0.22 

0.70 

-0.30 

BMW 

11 

KCC44 

C 

0 

8 

16 

0.22 

0.44 

1.04 

-0.24 

BMW 

11 

KCC44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

12 

KCC13 

* 

-1 

1266 

96 

1.38 

0.04 

0.00 

0.00 

BMW 

12 

KCC13 

A 

1 

36 

68 

1.65 

0.15 

0.94 

0.40 

BMW 

12 

KCC13 

B 

0 

8 

15 

0.63 

0.23 

0.63 

-0.36 

BMW 

12 

KCC13 

C 

0 

9 

17 

1.10 

0.27 

1.18 

-0.15 

BMW 

12 

KCC13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

13 

KMD21 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMW 

13 

KMD21 

A 

1 

44 

90 

1.65 

0.22 

0.91 

0.31 

BMW 

13 

KMD21 

B 

0 

4 

8 

0.20 

0.70 

0.95 

-0.26 

BMW 

13 

KMD21 

C 

0 

1 

2 

-0.31 

0.00 

0.32 

-0.17 

BMW 

13 

KMD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

14 

K0422 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

BMW 

14 

K0422 

A 

1 

15 

83 

1.88 

0.40 

2.06 

0.61 

BMW 

14 

K0422 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

14 

K0422 

C 

0 

3 

17 

-1.56 

1.73 

0.49 

-0.61 

BMW 

14 

K0422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

15 

K0498 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

BMW 

15 

K0498 

A 

1 

15 

83 

2.11 

0.39 

0.83 

0.43 

BMW 

15 

K0498 

B 

0 

1 

6 

-0.56 

0.00 

0.19 

-0.38 

BMW 

15 

K0498 

C 

0 

2 

11 

0.80 

0.61 

0.87 

-0.24 

BMW 

15 

K0498 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

16 

K0334 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

BMW 

16 

K0334 

A 

1 

13 

68 

2.32 

0.47 

0.80 

0.62 

BMW 

16 

K0334 

B 

0 

4 

21 

-0.09 

0.55 

0.66 

-0.47 

BMW 

16 

K0334 

C 

0 

2 

11 

-0.15 

0.00 

0.38 

-0.32 

BMW 

16 

K0334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

17 

K0323 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

BMW 

17 

K0323 

A 

1 

8 

44 

2.40 

0.65 

1.32 

0.56 

BMW 

17 

K0323 

B 

0 

1 

6 

0.10 

0.00 

0.37 

-0.17 

BMW 

17 

K0323 

C 

0 

7 

39 

0.57 

0.44 

0.99 

-0.35 

BMW 

17 

K0323 

D 

0 

2 

11 

0.32 

1.46 

1.04 

-0.21 

BMW 

18 

K0052 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

BMW 

18 

K0052 

A 

1 

15 

88 

1.55 

0.52 

1.33 

0.32 

BMW 

18 

K0052 

B 

0 

1 

6 

-0.40 

0.00 

0.58 

-0.22 

BMW 

18 

K0052 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

18 

K0052 

D 

0 

1 

6 

-0.29 

0.00 

0.65 

-0.21 

BMW 

19 

KOI 20 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

BMW 

19 

KOI 20 

A 

1 

15 

88 

1.99 

0.36 

0.97 

0.28 

BMW 

19 

KOI 20 

B 

0 

1 

6 

0.17 

0.00 

0.36 

-0.31 

BMW 

19 

KOI 20 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

19 

KOI 20 

D 

0 

1 

6 

1.45 

0.00 

1.28 

-0.08 

BMW 

20 

K0130 

* 

-1 

1199 

91 

1.41 

0.04 

0.00 

0.06 

BMW 

20 

K0130 

A 

1 

87 

73 

1.29 

0.17 

1.59 

0.24 

BMW 

20 

K0130 

B 

0 

22 

18 

0.53 

0.14 

1.04 

-0.18 

BMW 

20 

K0130 

C 

0 

11 

9 

0.48 

0.32 

1.26 

-0.13 

BMW 

20 

K0130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

21 

K0136 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMW 

21 

K0136 

A 

1 

13 

72 

2.19 

0.45 

0.99 

0.50 

BMW 

21 

K0136 

B 

0 

3 

17 

0.08 

0.16 

0.38 

-0.46 

BMW 

21 

K0136 

C 

0 

2 

11 

0.98 

0.26 

0.94 

-0.16 

BMW 

21 

K0136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

22 

KOA113 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

BMW 

22 

KOA113 

A 

1 

30 

60 

1.87 

0.19 

1.18 

0.30 

BMW 

22 

KOA113 

B 

0 

4 

8 

0.91 

0.44 

0.67 

-0.20 

BMW 

22 

KOA113 

C 

0 

16 

32 

1.30 

0.26 

1.43 

-0.20 

BMW 

22 

KOA113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

23 

KNBT140 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMW 

23 

KNBT140 

A 

1 

31 

63 

2.06 

0.27 

0.97 

0.50 

BMW 

23 

KNBT140 

B 

0 

9 

18 

0.60 

0.21 

0.70 

-0.28 

BMW 

23 

KNBT140 

C 

0 

9 

18 

0.42 

0.34 

0.71 

-0.34 

BMW 

23 

KNBT140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

24 

KNBT158 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMW 

24 

KNBT158 

A 

1 

26 

53 

2.23 

0.31 

1.03 

0.53 

BMW 

24 

KNBT158 

B 

0 

11 

22 

0.65 

0.15 

0.62 

-0.30 

BMW 

24 

KNBT158 

C 

0 

12 

24 

0.66 

0.31 

0.84 

-0.32 

BMW 

24 

KNBT158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

25 

KOA514 

* 

-1 

1220 

92 

1.38 

0.04 

0.00 

-0.01 

BMW 

25 

KOA514 

A 

1 

26 

26 

2.18 

0.28 

1.32 

0.43 

BMW 

25 

KOA514 

B 

0 

47 

47 

1.27 

0.11 

0.94 

-0.14 

BMW 

25 

KOA514 

C 

0 

26 

26 

0.94 

0.14 

0.66 

-0.27 

BMW 

25 

KOA514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

10003 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

BMW 

26 

10003 

A 

1 

20 

83 

1.27 

0.31 

0.88 

0.51 

BMW 

26 

10003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

26 

10003 

C 

0 

3 

13 

-0.66 

0.74 

0.58 

-0.40 

BMW 

26 

10003 

D 

0 

1 

4 

-1.22 

0.00 

0.22 

-0.30 

BMW 

27 

IMDlll 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

BMW 

27 

IMDlll 

A 

1 

65 

90 

1.88 

0.11 

0.94 

0.28 

BMW 

27 

IMDlll 

B 

0 

3 

4 

0.86 

0.25 

0.56 

-0.21 

BMW 

27 

IMDlll 

C 

0 

4 

6 

1.10 

0.60 

1.19 

-0.18 

BMW 

27 

IMDlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

28 

10A413 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

BMW 

28 

10A413 

A 

1 

118 

81 

1.87 

0.10 

1.16 

0.44 

BMW 

28 

10A413 

B 

0 

12 

8 

0.31 

0.21 

0.50 

-0.33 

BMW 

28 

10A413 

C 

0 

16 

11 

0.70 

0.20 

0.81 

-0.27 

BMW 

28 

10A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

29 

1NBT522 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

BMW 

29 

1NBT522 

A 

1 

47 

55 

2.04 

0.16 

0.83 

0.52 

BMW 

29 

1NBT522 

B 

0 

8 

9 

0.45 

0.25 

0.51 

-0.28 

BMW 

29 

1NBT522 

C 

0 

31 

36 

0.87 

0.18 

1.22 

-0.38 

BMW 

29 

1NBT522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

30 

1MD217 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

BMW 

30 

1MD217 

A 

1 

53 

56 

2.19 

0.15 

1.02 

0.34 

BMW 

30 

1MD217 

B 

0 

18 

19 

1.43 

0.19 

0.94 

-0.19 

BMW 

30 

1MD217 

C 

0 

24 

25 

1.46 

0.22 

1.27 

-0.21 

BMW 

30 

1MD217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

30260 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.01 

BMS 

1 

30260 

A 

1 

13 

93 

1.59 

0.46 

1.33 

0.11 

BMS 

1 

30260 

B 

0 

1 

7 

0.90 

0.00 

1.32 

-0.11 

BMS 

1 

30260 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

1 

30260 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

KOI 05 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

BMS 

2 

KOI 05 

A 

1 

15 

88 

2.03 

0.35 

0.72 

0.56 

BMS 

2 

KOI 05 

B 

0 

1 

6 

-0.04 

0.00 

0.37 

-0.29 

BMS 

2 

KOI 05 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

KOI 05 

D 

0 

1 

6 

-1.08 

0.00 

0.13 

-0.47 

BMS 

3 

30116 

* 

-1 

1307 

99 

1.39 

0.04 

0.00 

0.03 

BMS 

3 

30116 

A 

1 

7 

58 

1.57 

0.50 

0.77 

0.63 

BMS 

3 

30116 

B 

0 

1 

8 

0.06 

0.00 

0.63 

-0.17 

BMS 

3 

30116 

C 

0 

2 

17 

0.10 

0.63 

0.78 

-0.25 

BMS 

3 

30116 

D 

0 

2 

17 

-0.57 

0.81 

0.45 

-0.46 

BMS 

4 

30579 

* 

-1 

1297 

98 

1.38 

0.04 

0.00 

-0.03 

BMS 

4 

30579 

A 

1 

15 

68 

2.47 

0.35 

0.57 

0.68 

BMS 

4 

30579 

B 

0 

3 

14 

0.74 

0.54 

0.86 

-0.23 

BMS 

4 

30579 

C 

0 

2 

9 

-0.57 

0.73 

0.23 

-0.43 

BMS 

4 

30579 

D 

0 

2 

9 

-0.44 

0.68 

0.25 

-0.41 

BMS 

5 

KG37 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

BMS 

5 

KG37 

A 

1 

20 

40 

1.36 

0.34 

1.23 

0.31 

BMS 

5 

KG37 

B 

0 

15 

30 

0.72 

0.21 

1.19 

-0.11 

BMS 

5 

KG37 

C 

0 

15 

30 

0.53 

0.20 

0.92 

-0.22 

BMS 

5 

KG37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

KG340 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

BMS 

6 

KG340 

A 

1 

19 

39 

1.70 

0.26 

1.08 

0.39 

BMS 

6 

KG340 

B 

0 

12 

24 

1.14 

0.34 

1.73 

-0.01 

BMS 

6 

KG340 

C 

0 

18 

37 

0.58 

0.20 

0.75 

-0.38 

BMS 

6 

KG340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

7 

KMD342 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

BMS 

7 

KMD342 

A 

1 

38 

79 

1.76 

0.19 

0.89 

0.44 

BMS 

7 

KMD342 

B 

0 

5 

10 

0.06 

0.41 

0.50 

-0.38 

BMS 

7 

KMD342 

C 

0 

5 

10 

0.72 

0.65 

1.77 

-0.20 

BMS 

7 

KMD342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

8 

K0026 

* 

-1 

1199 

91 

1.36 

0.04 

0.00 

-0.06 

BMS 

8 

K0026 

A 

1 

112 

93 

1.77 

0.11 

0.95 

0.32 

BMS 

8 

K0026 

B 

0 

3 

3 

0.71 

0.17 

0.74 

-0.12 

BMS 

8 

K0026 

C 

0 

4 

3 

-0.33 

0.81 

0.52 

-0.29 

BMS 

8 

K0026 

D 

0 

1 

1 

0.29 

0.00 

0.47 

-0.10 

BMS 

9 

KCC14 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

BMS 

9 

KCC14 

A 

1 

41 

85 

1.64 

0.20 

1.13 

0.31 

BMS 

9 

KCC14 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

9 

KCC14 

C 

0 

7 

15 

0.51 

0.23 

0.75 

-0.31 

BMS 

9 

KCC14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

10 

KCC38 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

BMS 

10 

KCC38 

A 

1 

39 

83 

1.61 

0.19 

0.96 

0.31 

BMS 

10 

KCC38 

B 

0 

5 

11 

0.66 

0.31 

0.82 

-0.23 

BMS 

10 

KCC38 

C 

0 

3 

6 

0.64 

0.94 

1.48 

-0.18 

BMS 

10 

KCC38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 



easyCBM CCSS Kindergarten Math Measure Development 


150 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

11 

KCC21 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

BMS 

11 

KCC21 

A 

1 

34 

69 

1.40 

0.16 

0.92 

0.46 

BMS 

11 

KCC21 

B 

0 

5 

10 

-0.01 

0.40 

0.53 

-0.37 

BMS 

11 

KCC21 

C 

0 

10 

20 

0.61 

0.21 

0.92 

-0.25 

BMS 

11 

KCC21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

12 

KCC116 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

BMS 

12 

KCC116 

A 

1 

30 

61 

1.37 

0.18 

1.04 

0.34 

BMS 

12 

KCC116 

B 

0 

13 

27 

0.64 

0.29 

1.18 

-0.27 

BMS 

12 

KCC116 

C 

0 

6 

12 

0.72 

0.25 

0.91 

-0.14 

BMS 

12 

KCC116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

13 

KMD21 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMS 

13 

KMD21 

A 

1 

44 

90 

1.65 

0.22 

0.91 

0.31 

BMS 

13 

KMD21 

B 

0 

4 

8 

0.20 

0.70 

0.95 

-0.26 

BMS 

13 

KMD21 

C 

0 

1 

2 

-0.31 

0.00 

0.32 

-0.17 

BMS 

13 

KMD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

14 

K0362 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

BMS 

14 

K0362 

A 

1 

13 

76 

1.77 

0.39 

0.49 

0.78 

BMS 

14 

K0362 

B 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

BMS 

14 

K0362 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

14 

K0362 

D 

0 

3 

18 

-1.46 

0.45 

0.19 

-0.46 

BMS 

15 

K0421 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

BMS 

15 

K0421 

A 

1 

12 

67 

1.62 

0.60 

2.74 

0.52 

BMS 

15 

K0421 

B 

0 

2 

11 

-0.44 

0.04 

0.50 

-0.22 

BMS 

15 

K0421 

C 

0 

3 

17 

-0.08 

0.63 

1.08 

-0.20 

BMS 

15 

K0421 

D 

0 

1 

6 

-2.88 

0.00 

0.04 

-0.44 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

16 

K0483 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

BMS 

16 

K0483 

A 

1 

14 

78 

2.26 

0.34 

0.89 

0.49 

BMS 

16 

K0483 

B 

0 

1 

6 

2.33 

0.00 

2.56 

0.08 

BMS 

16 

K0483 

C 

0 

2 

11 

-0.02 

0.13 

0.25 

-0.50 

BMS 

16 

K0483 

D 

0 

1 

6 

0.36 

0.00 

0.36 

-0.28 

BMS 

17 

K0418 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

0.01 

BMS 

17 

K0418 

A 

1 

7 

44 

2.74 

0.73 

0.90 

0.64 

BMS 

17 

K0418 

B 

0 

3 

19 

-0.29 

0.84 

0.51 

-0.35 

BMS 

17 

K0418 

C 

0 

4 

25 

-0.36 

0.92 

0.53 

-0.44 

BMS 

17 

K0418 

D 

0 

2 

13 

1.43 

0.42 

1.62 

0.03 

BMS 

18 

K0191 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

BMS 

18 

K0191 

A 

1 

18 

95 

2.16 

0.32 

0.91 

0.38 

BMS 

18 

K0191 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

18 

K0191 

C 

0 

1 

5 

-0.21 

0.00 

0.25 

-0.38 

BMS 

18 

K0191 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

19 

K0092 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

BMS 

19 

K0092 

A 

1 

15 

83 

1.60 

0.36 

1.04 

0.29 

BMS 

19 

K0092 

B 

0 

2 

11 

0.39 

1.06 

1.01 

-0.28 

BMS 

19 

K0092 

C 

0 

1 

6 

0.95 

0.00 

1.08 

-0.09 

BMS 

19 

K0092 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

20 

K0022 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMS 

20 

K0022 

A 

1 

14 

78 

2.04 

0.43 

0.86 

0.42 

BMS 

20 

K0022 

B 

0 

2 

11 

1.09 

1.55 

2.86 

-0.12 

BMS 

20 

K0022 

C 

0 

2 

11 

-0.39 

0.58 

0.31 

-0.43 

BMS 

20 

K0022 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

21 

KOI 68 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMS 

21 

KOI 68 

A 

1 

13 

72 

2.36 

0.33 

0.64 

0.71 

BMS 

21 

KOI 68 

B 

0 

2 

11 

0.80 

0.62 

0.80 

-0.21 

BMS 

21 

KOI 68 

C 

0 

3 

17 

-0.64 

0.36 

0.18 

-0.68 

BMS 

21 

KOI 68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

22 

30603 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

BMS 

22 

30603 

A 

1 

10 

63 

2.64 

0.55 

1.12 

0.53 

BMS 

22 

30603 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

22 

30603 

C 

0 

3 

19 

-1.29 

1.93 

0.59 

-0.60 

BMS 

22 

30603 

D 

0 

3 

19 

1.40 

0.84 

1.68 

-0.06 

BMS 

23 

KNBT198 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.06 

BMS 

23 

KNBT198 

A 

1 

26 

54 

1.37 

0.26 

1.02 

0.39 

BMS 

23 

KNBT198 

B 

0 

16 

33 

0.39 

0.15 

0.82 

-0.35 

BMS 

23 

KNBT198 

C 

0 

6 

13 

0.65 

0.32 

1.07 

-0.10 

BMS 

23 

KNBT198 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

24 

KNBT127 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

BMS 

24 

KNBT127 

A 

1 

26 

53 

2.12 

0.34 

1.70 

0.45 

BMS 

24 

KNBT127 

B 

0 

12 

24 

0.63 

0.22 

0.69 

-0.33 

BMS 

24 

KNBT127 

C 

0 

11 

22 

0.95 

0.19 

0.87 

-0.20 

BMS 

24 

KNBT127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

25 

KNBT134 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

BMS 

25 

KNBT134 

A 

1 

17 

35 

1.59 

0.19 

0.96 

0.37 

BMS 

25 

KNBT134 

B 

0 

8 

17 

0.88 

0.39 

1.49 

-0.09 

BMS 

25 

KNBT134 

C 

0 

23 

48 

0.77 

0.21 

1.04 

-0.29 

BMS 

25 

KNBT134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

10211 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

26 

10211 

A 

1 

18 

86 

1.08 

0.30 

1.27 

0.28 

BMS 

26 

10211 

B 

0 

3 

14 

0.09 

0.39 

0.77 

-0.28 

BMS 

26 

10211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

26 

10211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

27 

1MD215 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

27 

1MD215 

A 

1 

63 

89 

2.05 

0.14 

0.82 

0.50 

BMS 

27 

1MD215 

B 

0 

3 

4 

0.20 

0.52 

0.41 

-0.29 

BMS 

27 

1MD215 

C 

0 

5 

7 

0.13 

0.21 

0.32 

-0.39 

BMS 

27 

1MD215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

28 

10062 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMS 

28 

10062 

A 

1 

17 

71 

1.81 

0.46 

1.07 

0.47 

BMS 

28 

10062 

B 

0 

1 

4 

-0.95 

0.00 

0.23 

-0.26 

BMS 

28 

10062 

C 

0 

6 

25 

0.13 

0.18 

0.75 

-0.37 

BMS 

28 

10062 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

29 

1NBT57 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

29 

1NBT57 

A 

1 

43 

61 

2.16 

0.19 

1.28 

0.37 

BMS 

29 

1NBT57 

B 

0 

11 

16 

1.17 

0.33 

1.15 

-0.24 

BMS 

29 

1NBT57 

C 

0 

16 

23 

1.32 

0.20 

1.02 

-0.23 

BMS 

29 

1NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

30 

1MD121 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

BMS 

30 

1MD121 

A 

1 

39 

54 

2.16 

0.18 

1.38 

0.22 

BMS 

30 

1MD121 

B 

0 

3 

4 

0.94 

0.38 

0.43 

-0.19 

BMS 

30 

1MD121 

C 

0 

30 

42 

1.76 

0.19 

1.38 

-0.14 

BMS 

30 

1MD121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix D: Item Statistics 


Appendix D: Item Statistics for Full CCSS Item Bank 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30001 

1.24 

12 

7 

0.70 

0.59 

- 1.62 

0.49 

- 1.29 

0.00 

0.74 

1.94 

30011 

0.98 

11 

5 

0.65 

1.16 

0.75 

1.10 

0.45 

0.00 

0.20 

0.48 

30101 

1.17 

17 

9 

0.61 

1.40 

1.34 

1.51 

1.07 

0.00 

0.41 

0.28 

30102 

1.23 

18 

10 

0.62 

0.83 

- 0.48 

0.68 

- 0.51 

0.00 

0.68 

1.29 

30103 

0.96 

124 

69 

0.20 

0.94 

- 0.82 

0.88 

- 0.86 

0.00 

0.48 

1.20 

30104 

0.62 

10 

7 

0.85 

0.88 

- 0.24 

0.71 

- 0.18 

0.00 

0.61 

1.30 

30105 

- 1.14 

19 

17 

0.79 

1.06 

0.28 

1.10 

0.40 

0.00 

0.23 

0.94 

30106 

- 0.51 

18 

14 

0.64 

1.15 

0.58 

1.00 

0.31 

0.00 

0.38 

0.74 

30109 

- 0.05 

22 

15 

0.56 

1.07 

0.36 

0.90 

0.00 

0.00 

0.52 

0.93 

30111 

- 0.40 

16 

11 

0.64 

0.73 

- 0.90 

0.50 

- 0.65 

0.00 

0.68 

1.47 

30112 

0.50 

16 

10 

0.63 

0.91 

- 0.29 

0.77 

- 0.46 

0.00 

0.60 

1.30 

30113 

- 0.31 

14 

10 

0.68 

1.14 

0.52 

1.12 

0.39 

0.00 

0.38 

0.75 

30114 

0.68 

18 

12 

0.60 

1.11 

0.45 

1.17 

0.51 

0.00 

0.47 

0.80 

30115 

- 0.81 

18 

15 

0.77 

1.84 

1.55 

5.88 

2.79 

0.00 

0.08 

- 0.03 

30116 

0.34 

12 

7 

0.68 

0.81 

- 0.71 

0.69 

- 0.62 

0.00 

0.63 

1.57 

30117 

1.12 

14 

9 

0.74 

0.88 

- 0.23 

0.70 

- 0.43 

0.00 

0.70 

1.25 

30118 

0.76 

14 

9 

0.65 

1.36 

1.35 

1.88 

1.57 

0.00 

0.26 

0.02 

30123 

0.49 

113 

75 

0.22 

0.94 

- 0.63 

1.12 

0.80 

0.00 

0.45 

1.09 

30124 

0.89 

14 

8 

0.63 

0.63 

- 1.56 

0.52 

- 0.80 

0.00 

0.70 

1.84 

30125 

- 1.09 

20 

17 

0.82 

0.63 

- 0.70 

0.29 

- 0.38 

0.00 

0.69 

1.36 

30126 

1.14 

15 

8 

0.59 

1.33 

1.37 

1.30 

0.98 

0.00 

0.29 

0.13 

30127 

- 2.17 

19 

18 

1.07 

0.89 

0.13 

0.35 

- 0.16 

0.00 

0.32 

1.12 

30128 

0.13 

19 

16 

0.72 

0.71 

- 0.60 

0.44 

- 0.64 

0.00 

0.59 

1.33 

30129 

0.63 

16 

10 

0.69 

1.26 

0.76 

1.51 

0.89 

0.00 

0.54 

0.61 

30130 

2.87 

10 

2 

0.91 

1.14 

0.43 

2.04 

1.06 

0.00 

0.28 

0.63 

30134 

- 0.69 

21 

16 

0.62 

0.97 

0.03 

0.93 

0.17 

0.00 

0.54 

1.02 

30135 

- 1.84 

17 

15 

1.12 

0.81 

- 0.03 

0.25 

- 0.32 

0.00 

0.71 

1.19 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30251 

- 0.91 

18 

15 

0.73 

0.71 

- 0.58 

0.51 

- 0.53 

0.00 

0.55 

1.35 

30252 

- 0.55 

17 

14 

0.71 

0.75 

- 0.67 

0.45 

- 0.21 

0.00 

0.54 

1.37 

30254 

- 1.95 

17 

16 

1.06 

0.99 

0.27 

0.52 

0.06 

0.00 

0.25 

1.05 

30255 

- 0.70 

16 

14 

0.84 

0.88 

- 0.04 

1.17 

0.50 

0.00 

0.39 

1.01 

30256 

- 0.92 

14 

11 

0.76 

1.03 

0.21 

0.90 

0.10 

0.00 

0.48 

0.99 

30257 

0.71 

25 

17 

0.55 

1.62 

1.86 

1.74 

1.42 

0.00 

0.38 

0.20 

30259 

- 1.65 

no 

102 

0.40 

0.77 

- 0.74 

0.38 

- 1.19 

0.00 

0.48 

1.16 

30260 

- 1.87 

14 

13 

1.14 

1.45 

0.76 

1.32 

0.68 

0.00 

0.11 

0.73 

30261 

- 2.41 

19 

18 

1.19 

1.28 

0.59 

0.32 

- 0.20 

0.00 

0.39 

0.97 

30262 

- 0.72 

24 

21 

0.66 

0.81 

- 0.41 

0.50 

- 0.33 

0.00 

0.45 

1.24 

30264 

0.00 

10 

10 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30265 

- 2.27 

21 

20 

1.20 

0.37 

- 0.72 

0.08 

- 0.72 

0.00 

0.56 

1.33 

30266 

- 1.01 

18 

15 

0.70 

0.88 

- 0.20 

1.21 

0.52 

0.00 

0.40 

1.02 

30267 

0.00 

17 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30268 

- 2.36 

20 

19 

1.08 

1.18 

0.48 

0.82 

0.33 

0.00 

0.19 

0.91 

30269 

0.07 

14 

11 

0.71 

1.29 

0.89 

1.07 

0.32 

0.00 

0.25 

0.63 

30271 

- 1.65 

13 

11 

1.09 

0.72 

- 0.13 

0.28 

- 0.26 

0.00 

0.78 

1.23 

30272 

0.00 

15 

15 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30273 

0.00 

15 

15 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30274 

- 1.93 

114 

106 

0.38 

0.86 

- 0.42 

0.72 

- 0.41 

0.00 

0.33 

1.10 

30276 

- 0.13 

503 

377 

0.12 

1.09 

1.42 

1.00 

0.02 

0.00 

0.48 

0.90 

30289 

- 0.42 

501 

395 

0.13 

1.08 

1.10 

1.06 

0.43 

0.00 

0.46 

0.91 

30309 

0.33 

15 

9 

0.67 

1.71 

2.02 

3.52 

2.67 

0.00 

0.26 

- 0.46 

30401 

- 1.62 

15 

12 

1.04 

0.85 

0.04 

0.38 

- 0.12 

0.00 

0.77 

1.16 

30403 

- 1.89 

18 

15 

0.84 

0.77 

- 0.33 

0.43 

- 0.04 

0.00 

0.63 

1.24 

30405 

- 0.03 

15 

11 

0.67 

0.65 

- 1.07 

0.49 

- 0.80 

0.00 

0.65 

1.55 

30406 

0.87 

20 

14 

0.59 

0.94 

- 0.17 

0.79 

- 0.36 

0.00 

0.57 

1.19 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30407 

1.09 

10 

6 

0.72 

0.54 

- 1.73 

0.48 

- 1.19 

0.00 

0.79 

2.07 

30408 

0.34 

20 

13 

0.61 

0.84 

- 0.54 

0.90 

- 0.04 

0.00 

0.64 

1.23 

30410 

2.04 

19 

6 

0.60 

1.24 

0.88 

0.97 

0.15 

0.00 

0.47 

0.74 

30412 

0.50 

23 

15 

0.61 

0.66 

- 1.15 

0.44 

- 1.01 

0.00 

0.77 

1.48 

30413 

0.15 

19 

15 

0.65 

0.75 

- 0.71 

0.53 

- 0.64 

0.00 

0.60 

1.36 

30414 

0.29 

19 

13 

0.64 

1.47 

1.28 

1.30 

0.66 

0.00 

0.46 

0.49 

30418 

1.40 

9 

4 

0.80 

0.50 

- 1.68 

0.45 

- 1.47 

0.00 

0.66 

2.14 

30419 

1.56 

9 

4 

0.90 

1.80 

1.51 

2.23 

1.60 

0.00 

0.33 

- 0.18 

30421 

- 0.29 

100 

77 

0.25 

0.95 

- 0.35 

0.86 

- 0.48 

0.00 

0.36 

1.09 

30458 

1.03 

16 

11 

0.65 

1.50 

1.55 

1.90 

1.84 

0.00 

0.28 

- 0.08 

30459 

2.87 

14 

7 

0.93 

1.15 

0.44 

0.94 

0.35 

0.00 

0.78 

0.87 

30502 

1.57 

99 

41 

0.23 

1.02 

0.29 

1.18 

1.09 

0.00 

0.45 

0.89 

30511 

0.32 

125 

93 

0.23 

1.08 

0.74 

0.99 

0.04 

0.00 

0.37 

0.90 

30512 

- 2.61 

14 

13 

1.11 

0.69 

- 0.22 

0.23 

- 0.35 

0.00 

0.42 

1.27 

30514 

- 0.70 

18 

14 

0.67 

1.12 

0.46 

1.04 

0.38 

0.00 

0.44 

0.80 

30515 

0.99 

11 

6 

0.72 

1.20 

0.66 

1.02 

0.23 

0.00 

0.45 

0.73 

30516 

0.09 

19 

13 

0.59 

1.02 

0.16 

0.95 

0.07 

0.00 

0.52 

0.99 

30517 

1.03 

21 

12 

0.49 

0.92 

- 0.43 

0.98 

0.01 

0.00 

0.48 

1.21 

30518 

- 1.19 

119 

106 

0.32 

1.00 

0.09 

0.80 

- 0.35 

0.00 

0.33 

1.01 

30519 

- 1.02 

10 

7 

0.90 

1.46 

1.16 

1.22 

0.62 

0.00 

0.50 

0.26 

30520 

0.53 

20 

13 

0.54 

0.66 

- 1.54 

0.50 

- 1.06 

0.00 

0.71 

1.66 

30551 

0.95 

17 

10 

0.58 

0.70 

- 1.31 

0.53 

- 1.02 

0.00 

0.70 

1.64 

30552 

0.20 

18 

12 

0.57 

0.98 

0.00 

0.84 

- 0.26 

0.00 

0.50 

1.09 

30553 

0.99 

20 

11 

0.53 

1.49 

2.22 

1.62 

2.34 

0.00 

0.26 

- 0.62 

30554 

1.69 

19 

10 

0.53 

0.86 

- 0.59 

0.85 

- 0.48 

0.00 

0.59 

1.33 

30555 

3.17 

13 

5 

0.81 

0.49 

- 1.54 

0.31 

- 0.52 

0.00 

0.84 

1.71 

30556 

1.15 

19 

9 

0.52 

1.04 

0.26 

1.03 

0.19 

0.00 

0.42 

0.90 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30557 

- 0.09 

20 

17 

0.70 

0.67 

- 0.69 

0.44 

- 0.81 

0.00 

0.62 

1.34 

30558 

1.46 

19 

8 

0.53 

0.91 

- 0.43 

0.74 

0.06 

0.00 

0.50 

1.32 

30559 

0.46 

25 

17 

0.51 

0.89 

- 0.43 

0.80 

- 0.51 

0.00 

0.59 

1.25 

30560 

2.00 

16 

7 

0.67 

0.69 

- 1.03 

0.50 

- 0.76 

0.00 

0.77 

1.53 

30561 

0.69 

20 

14 

0.61 

1.09 

0.40 

0.92 

0.00 

0.00 

0.56 

0.91 

30562 

0.63 

11 

8 

0.81 

1.46 

1.24 

1.37 

0.86 

0.00 

0.36 

0.10 

30563 

0.83 

13 

9 

0.67 

0.65 

- 1.42 

0.58 

- 1.35 

0.00 

0.61 

1.96 

30564 

2.55 

11 

6 

0.71 

0.72 

- 1.59 

0.65 

- 0.90 

0.00 

0.70 

2.44 

30579 

0.54 

22 

15 

0.55 

0.65 

- 1.48 

0.53 

- 1.09 

0.00 

0.68 

1.61 

30580 

- 0.05 

20 

15 

0.59 

0.87 

- 0.37 

0.66 

- 0.57 

0.00 

0.53 

1.25 

30583 

1.30 

22 

14 

0.53 

0.77 

- 0.99 

0.64 

- 0.80 

0.00 

0.66 

1.45 

30601 

1.02 

16 

11 

0.62 

0.80 

- 0.76 

0.66 

- 0.57 

0.00 

0.59 

1.49 

30602 

1.86 

16 

7 

0.63 

1.05 

0.30 

0.94 

0.21 

0.00 

0.53 

0.90 

30603 

1.04 

16 

10 

0.66 

1.25 

0.90 

1.19 

0.59 

0.00 

0.53 

0.50 

30615 

1.29 

16 

9 

0.57 

0.95 

- 0.28 

0.90 

- 0.42 

0.00 

0.49 

1.33 

30617 

0.16 

20 

14 

0.57 

1.30 

1.11 

1.17 

0.56 

0.00 

0.37 

0.53 

30621 

- 0.02 

16 

12 

0.61 

0.91 

- 0.24 

0.70 

- 0.47 

0.00 

0.45 

1.23 

30701 

- 1.25 

19 

16 

0.70 

0.84 

- 0.34 

0.62 

- 0.21 

0.00 

0.44 

1.22 

30702 

0.40 

16 

10 

0.65 

1.06 

0.32 

1.00 

0.16 

0.00 

0.57 

0.85 

30703 

- 1.03 

15 

12 

0.75 

0.64 

- 0.91 

0.39 

- 0.61 

0.00 

0.64 

1.46 

30704 

1.67 

16 

8 

0.62 

0.74 

- 1.00 

0.55 

- 0.89 

0.00 

0.72 

1.54 

30705 

- 1.25 

9 

6 

0.84 

1.16 

0.50 

1.01 

0.27 

0.00 

0.46 

0.82 

30706 

- 0.90 

13 

9 

0.75 

1.14 

0.51 

0.86 

0.12 

0.00 

0.56 

0.86 

30707 

0.48 

18 

11 

0.56 

0.76 

- 1.04 

0.75 

- 0.66 

0.00 

0.62 

1.50 

30709 

- 0.31 

13 

9 

0.65 

1.50 

1.62 

1.51 

1.12 

0.00 

- 0.11 

- 0.01 

30710 

0.79 

16 

11 

0.73 

2.10 

2.53 

2.92 

1.93 

0.00 

0.28 

- 0.93 

30711 

0.31 

15 

10 

0.70 

0.62 

- 1.18 

0.45 

- 0.90 

0.00 

0.74 

1.60 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30714 

0.49 

16 

11 

0.63 

1.23 

1.04 

1.10 

0.37 

0.00 

0.40 

0.42 

30715 

- 0.90 

104 

89 

0.30 

1.06 

0.40 

0.88 

- 0.24 

0.00 

0.26 

0.97 

30716 

0.53 

14 

10 

0.69 

1.09 

0.37 

0.83 

- 0.05 

0.00 

0.47 

0.95 

30717 

- 0.06 

11 

8 

0.78 

0.77 

- 0.51 

0.58 

- 0.60 

0.00 

0.60 

1.41 

30718 

- 0.89 

118 

103 

0.30 

1.14 

0.75 

1.09 

0.36 

0.00 

0.22 

0.89 

30724 

- 0.18 

18 

14 

0.66 

1.12 

0.47 

0.73 

- 0.14 

0.00 

0.46 

0.96 

30725 

- 0.97 

115 

100 

0.31 

0.94 

- 0.21 

0.75 

- 0.54 

0.00 

0.44 

1.07 

30756 

2.17 

20 

7 

0.56 

1.47 

1.77 

2.82 

3.08 

0.00 

0.20 

- 0.32 

30757 

1.65 

13 

6 

0.66 

1.08 

0.35 

1.01 

0.16 

0.00 

0.46 

0.88 

30758 

0.70 

22 

13 

0.51 

1.43 

2.02 

2.68 

3.39 

0.00 

0.21 

- 0.60 

30760 

0.85 

20 

15 

0.71 

0.91 

- 0.14 

0.93 

0.12 

0.00 

0.68 

1.09 

30761 

0.08 

15 

10 

0.69 

1.00 

0.09 

0.88 

0.12 

0.00 

0.59 

1.04 

30851 

- 0.17 

122 

94 

0.24 

0.90 

- 0.76 

0.85 

- 0.55 

0.00 

0.47 

1.13 

30852 

0.66 

22 

13 

0.52 

0.82 

- 0.71 

0.66 

- 0.84 

0.00 

0.65 

1.36 

30853 

1.95 

19 

8 

0.61 

1.39 

1.11 

1.43 

0.92 

0.00 

0.49 

0.53 

30854 

0.00 

15 

10 

0.64 

1.60 

1.85 

1.99 

1.81 

0.00 

0.13 

- 0.24 

30855 

1.06 

18 

10 

0.60 

1.52 

1.54 

1.54 

0.84 

0.00 

0.37 

0.26 

30856 

1.38 

20 

10 

0.51 

1.74 

3.05 

2.02 

2.53 

0.00 

- 0.10 

- 0.96 

30864 

- 0.17 

18 

14 

0.66 

1.69 

1.70 

1.55 

1.02 

0.00 

0.15 

0.23 

30865 

- 0.30 

17 

12 

0.62 

1.30 

0.97 

1.42 

0.97 

0.00 

0.31 

0.54 

30871 

1.72 

19 

6 

0.60 

0.98 

0.01 

0.89 

- 0.07 

0.00 

0.51 

1.06 

30872 

- 0.05 

12 

9 

0.80 

0.74 

- 0.59 

0.54 

- 0.65 

0.00 

0.63 

1.43 

30873 

- 2.26 

23 

22 

1.04 

0.91 

0.19 

0.40 

- 0.09 

0.00 

0.26 

1.09 

30874 

- 0.30 

18 

14 

0.66 

1.15 

0.54 

1.67 

1.00 

0.00 

0.36 

0.67 

30884 

1.09 

12 

7 

0.71 

0.56 

- 1.32 

0.44 

- 1.13 

0.00 

0.81 

1.67 

31001 

0.27 

18 

13 

0.63 

0.50 

- 1.93 

0.38 

- 1.42 

0.00 

0.73 

1.76 

31006 

0.61 

29 

19 

0.46 

1.00 

0.04 

0.99 

0.09 

0.00 

0.50 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31012 

1.88 

17 

8 

0.60 

1.27 

1.11 

1.25 

0.66 

0.00 

0.46 

0.39 

31013 

0.41 

22 

14 

0.56 

0.94 

- 0.12 

1.02 

0.20 

0.00 

0.61 

1.04 

31014 

1.01 

16 

8 

0.60 

0.94 

- 0.15 

0.80 

- 0.39 

0.00 

0.57 

1.18 

31015 

- 0.61 

26 

22 

0.61 

1.04 

0.22 

1.55 

0.82 

0.00 

0.35 

0.86 

31016 

0.10 

9 

6 

0.81 

1.05 

0.27 

0.86 

0.03 

0.00 

0.46 

0.96 

31018 

2.04 

19 

5 

0.62 

1.22 

0.80 

1.36 

0.66 

0.00 

0.38 

0.62 

31019 

- 1.92 

15 

13 

1.09 

1.34 

0.65 

3.43 

1.55 

0.00 

0.47 

0.53 

31020 

1.66 

111 

48 

0.22 

1.12 

1.46 

2.21 

5.62 

0.00 

0.33 

0.49 

31021 

1.29 

12 

6 

0.78 

1.25 

0.75 

1.50 

0.78 

0.00 

0.56 

0.45 

31023 

3.08 

23 

6 

0.58 

1.40 

1.21 

1.49 

0.94 

0.00 

0.34 

0.51 

31024 

1.15 

16 

10 

0.61 

1.17 

0.74 

1.34 

0.85 

0.00 

0.40 

0.56 

31025 

1.37 

21 

9 

0.54 

1.15 

0.71 

1.06 

0.30 

0.00 

0.49 

0.71 

31160 

1.26 

20 

11 

0.54 

1.24 

0.92 

1.32 

0.93 

0.00 

0.40 

0.58 

31162 

0.58 

18 

13 

0.61 

1.08 

0.36 

1.08 

0.32 

0.00 

0.44 

0.87 

31163 

0.87 

20 

13 

0.63 

1.96 

2.30 

2.25 

1.39 

0.00 

0.37 

- 0.27 

31185 

- 0.74 

21 

17 

0.62 

0.59 

- 1.32 

0.40 

- 0.92 

0.00 

0.62 

1.51 

31186 

0.00 

20 

20 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

31203 

- 0.81 

22 

19 

0.76 

1.33 

0.77 

0.89 

0.21 

0.00 

0.41 

0.83 

31205 

1.53 

113 

47 

0.21 

1.10 

1.19 

1.12 

1.07 

0.00 

0.31 

0.71 

31206 

- 1.61 

14 

12 

0.88 

0.58 

- 0.70 

0.32 

- 0.45 

0.00 

0.62 

1.37 

31208 

1.93 

21 

8 

0.53 

1.19 

0.85 

1.15 

0.59 

0.00 

0.38 

0.63 

31209 

2.17 

25 

9 

0.47 

1.07 

0.42 

1.23 

0.77 

0.00 

0.36 

0.77 

31210 

0.58 

13 

9 

0.73 

0.76 

- 0.76 

0.58 

- 0.52 

0.00 

0.67 

1.50 

31212 

- 0.20 

22 

16 

0.53 

1.12 

0.51 

1.10 

0.37 

0.00 

0.33 

0.83 

KOOOl 

- 1.58 

17 

15 

1.12 

0.52 

- 0.46 

0.18 

- 0.44 

0.00 

0.73 

1.32 

K0002 

- 0.82 

119 

97 

0.25 

0.85 

- 1.02 

0.74 

- 0.89 

0.00 

0.41 

1.19 

K0003 

- 1.74 

18 

17 

1.10 

0.88 

0.11 

0.27 

- 0.27 

0.00 

0.39 

1.15 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0004 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0005 

0.63 

18 

13 

0.67 

1.10 

0.40 

1.03 

0.24 

0.00 

0.57 

0.87 

K0006 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0007 

-1.34 

19 

16 

0.75 

1.59 

1.26 

3.37 

1.85 

0.00 

0.21 

0.31 

K0008 

-0.38 

18 

14 

0.72 

1.24 

0.70 

2.50 

1.61 

0.00 

0.45 

0.50 

K0009 

-2.26 

19 

17 

1.10 

0.70 

-0.15 

0.20 

-0.40 

0.00 

0.70 

1.22 

KOOlO 

-0.68 

17 

14 

0.83 

0.65 

-0.70 

0.35 

-0.31 

0.00 

0.69 

1.40 

KOOll 

-1.13 

68 

60 

0.42 

0.68 

-1.16 

0.38 

-1.20 

0.00 

0.53 

1.27 

K0012 

-2.13 

18 

15 

0.92 

0.38 

-1.22 

0.17 

-0.47 

0.00 

0.75 

1.48 

K0013 

-1.62 

18 

15 

0.88 

0.49 

-0.93 

0.21 

-0.39 

0.00 

0.76 

1.40 

K0014 

-0.12 

117 

91 

0.24 

1.02 

0.20 

1.12 

0.58 

0.00 

0.31 

0.95 

K0015 

-1.13 

18 

16 

0.85 

0.92 

0.02 

0.68 

0.12 

0.00 

0.44 

1.06 

K0016 

0.34 

19 

14 

0.61 

1.49 

1.51 

1.44 

0.92 

0.00 

0.26 

0.31 

K0017 

-1.48 

18 

17 

1.07 

1.24 

0.55 

3.65 

1.62 

0.00 

-0.15 

0.66 

K0018 

0.15 

17 

13 

0.68 

0.86 

-0.31 

0.73 

-0.30 

0.00 

0.56 

1.22 

K0019 

-0.46 

18 

14 

0.69 

0.72 

-0.79 

0.47 

-0.70 

0.00 

0.64 

1.42 

K0020 

1.13 

17 

10 

0.56 

0.76 

-1.21 

0.67 

-0.71 

0.00 

0.61 

1.71 

K0021 

0.32 

504 

346 

0.12 

0.90 

-1.92 

0.80 

-2.06 

0.00 

0.58 

1.19 

K0022 

-0.24 

18 

14 

0.65 

0.95 

-0.07 

1.41 

0.71 

0.00 

0.42 

0.90 

K0023 

1.33 

18 

9 

0.57 

1.00 

0.08 

0.87 

-0.16 

0.00 

0.58 

1.05 

K0024 

-1.87 

117 

108 

0.38 

0.91 

-0.22 

0.52 

-0.94 

0.00 

0.41 

1.09 

K0025 

1.03 

19 

12 

0.59 

1.01 

0.12 

0.80 

-0.24 

0.00 

0.59 

1.06 

K0026 

-1.57 

120 

112 

0.39 

0.98 

0.04 

0.62 

-0.56 

0.00 

0.32 

1.04 

K0027 

-2.06 

18 

17 

1.16 

0.50 

-0.55 

0.13 

-0.56 

0.00 

0.50 

1.33 

K0028 

-0.29 

18 

15 

0.76 

1.11 

0.40 

0.69 

-0.18 

0.00 

0.49 

1.00 

K0029 

1.35 

17 

9 

0.59 

1.56 

1.78 

1.72 

1.48 

0.00 

0.27 

0.06 

K0030 

2.21 

117 

38 

0.22 

1.03 

0.37 

1.06 

0.34 

0.00 

0.41 

0.92 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0031 

2.10 

18 

9 

0.60 

0.64 

-1.52 

0.51 

-1.07 

0.00 

0.77 

1.73 

K0032 

0.57 

18 

11 

0.62 

1.54 

1.72 

2.51 

2.31 

0.00 

0.38 

-0.22 

K0033 

1.80 

19 

9 

0.59 

1.12 

0.48 

1.25 

0.71 

0.00 

0.56 

0.78 

K0034 

-0.68 

17 

14 

0.70 

1.14 

0.48 

1.65 

0.88 

0.00 

0.21 

0.68 

K0035 

1.75 

18 

6 

0.58 

0.88 

-0.49 

0.72 

-0.46 

0.00 

0.50 

1.35 

K0036 

-1.23 

122 

no 

0.32 

0.76 

-1.09 

0.48 

-1.30 

0.00 

0.47 

1.19 

K0037 

-0.25 

503 

385 

0.13 

0.93 

-1.17 

0.72 

-2.20 

0.00 

0.55 

1.14 

K0038 

-0.29 

19 

15 

0.71 

1.10 

0.38 

1.04 

0.31 

0.00 

0.55 

0.88 

K0039 

0.26 

16 

11 

0.61 

0.81 

-0.79 

0.77 

-0.83 

0.00 

0.52 

1.59 

K0040 

-0.49 

18 

13 

0.66 

0.66 

-1.21 

0.41 

-0.44 

0.00 

0.70 

1.53 

K0041 

-0.64 

18 

13 

0.74 

1.36 

0.91 

1.55 

0.84 

0.00 

0.56 

0.55 

K0042 

-0.52 

18 

15 

0.70 

1.39 

0.99 

1.04 

0.32 

0.00 

0.21 

0.69 

K0043 

-0.49 

17 

14 

0.80 

0.60 

-0.93 

0.36 

-0.75 

0.00 

0.69 

1.48 

K0044 

-1.44 

18 

17 

1.06 

1.09 

0.38 

0.79 

0.31 

0.00 

0.18 

0.95 

K0045 

0.60 

17 

9 

0.56 

0.65 

-1.70 

0.53 

-1.19 

0.00 

0.72 

1.82 

K0046 

1.34 

18 

11 

0.58 

0.82 

-0.76 

0.75 

-0.39 

0.00 

0.62 

1.51 

K0047 

1.67 

17 

7 

0.65 

1.16 

0.61 

0.91 

0.22 

0.00 

0.57 

0.81 

K0048 

0.99 

19 

10 

0.51 

1.00 

0.08 

0.95 

-0.06 

0.00 

0.45 

1.02 

K0049 

-0.88 

16 

13 

0.72 

1.23 

0.71 

1.08 

0.45 

0.00 

0.29 

0.71 

K0050 

-2.14 

18 

17 

1.13 

0.61 

-0.35 

0.16 

-0.50 

0.00 

0.48 

1.28 

K0051 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0052 

-1.64 

17 

15 

0.84 

1.21 

0.55 

0.72 

0.18 

0.00 

0.32 

0.93 

K0053 

-1.29 

18 

14 

0.85 

1.35 

0.75 

4.39 

2.04 

0.00 

0.55 

0.53 

K0054 

-1.07 

18 

16 

0.78 

1.19 

0.51 

2.48 

1.57 

0.00 

0.01 

0.70 

K0055 

-0.57 

503 

404 

0.13 

1.08 

1.12 

1.11 

0.72 

0.00 

0.45 

0.89 

K0056 

-0.86 

17 

15 

0.81 

1.01 

0.19 

0.90 

0.33 

0.00 

0.32 

0.97 

K0057 

0.32 

18 

13 

0.60 

0.74 

-0.82 

0.61 

-0.80 

0.00 

0.60 

1.42 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0058 

0.08 

18 

13 

0.71 

1.13 

0.45 

1.06 

0.33 

0.00 

0.60 

0.85 

K0059 

0.17 

18 

13 

0.70 

0.99 

0.11 

0.85 

0.09 

0.00 

0.63 

1.02 

K0060 

1.91 

18 

7 

0.60 

0.65 

-1.17 

0.67 

-0.77 

0.00 

0.74 

1.48 

K0061 

0.33 

18 

13 

0.62 

0.70 

-1.16 

0.54 

-0.95 

0.00 

0.64 

1.60 

K0062 

0.22 

19 

13 

0.60 

0.67 

-1.31 

0.57 

-1.05 

0.00 

0.67 

1.62 

K0063 

-2.23 

18 

17 

1.06 

1.01 

0.30 

0.53 

0.07 

0.00 

0.24 

1.03 

K0064 

2.00 

17 

7 

0.69 

0.60 

-1.16 

0.44 

-1.05 

0.00 

0.83 

1.55 

K0065 

1.83 

19 

10 

0.58 

0.97 

-0.03 

0.86 

-0.22 

0.00 

0.62 

1.10 

K0066 

1.54 

18 

11 

0.62 

0.62 

-1.35 

0.52 

-0.91 

0.00 

0.76 

1.60 

K0067 

1.00 

19 

9 

0.60 

1.34 

1.10 

1.10 

0.36 

0.00 

0.51 

0.60 

K0068 

2.84 

18 

4 

0.69 

1.14 

0.48 

1.37 

0.67 

0.00 

0.40 

0.78 

K0069 

0.96 

18 

11 

0.64 

0.89 

-0.26 

0.74 

-0.31 

0.00 

0.66 

1.21 

K0070 

-0.86 

18 

16 

0.87 

1.36 

0.74 

0.73 

0.00 

0.00 

0.34 

0.88 

K0071 

-0.30 

20 

16 

0.64 

0.52 

-1.68 

0.34 

-1.08 

0.00 

0.66 

1.61 

K0072 

-0.15 

18 

14 

0.66 

0.47 

-1.77 

0.33 

-1.34 

0.00 

0.74 

1.65 

K0073 

0.24 

18 

14 

0.63 

0.81 

-0.64 

0.54 

-0.68 

0.00 

0.56 

1.36 

K0074 

0.35 

19 

13 

0.64 

0.94 

-0.17 

0.77 

-0.19 

0.00 

0.64 

1.19 

K0075 

-0.32 

18 

14 

0.69 

1.10 

0.38 

1.17 

0.47 

0.00 

0.50 

0.85 

K0076 

0.65 

19 

11 

0.60 

1.08 

0.36 

0.98 

0.14 

0.00 

0.60 

0.90 

K0077 

0.82 

20 

12 

0.54 

0.88 

-0.44 

0.79 

-0.48 

0.00 

0.60 

1.28 

K0078 

0.70 

18 

14 

0.62 

0.91 

-0.26 

0.71 

-0.53 

0.00 

0.46 

1.26 

K0079 

-0.52 

17 

14 

0.76 

0.69 

-0.73 

0.42 

-0.32 

0.00 

0.63 

1.37 

K0080 

-0.83 

17 

15 

0.83 

0.65 

-0.59 

0.37 

-0.39 

0.00 

0.52 

1.33 

K0081 

2.80 

18 

7 

0.63 

0.91 

-0.22 

0.66 

-0.30 

0.00 

0.67 

1.22 

K0082 

-1.04 

18 

16 

0.82 

0.71 

-0.54 

0.32 

-0.23 

0.00 

0.51 

1.32 

K0083 

-0.72 

18 

14 

0.72 

0.94 

-0.06 

0.60 

-0.25 

0.00 

0.61 

1.17 

K0084 

-0.79 

17 

13 

0.77 

0.87 

-0.13 

0.53 

-0.27 

0.00 

0.69 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0085 

-0.50 

17 

14 

0.69 

0.75 

-0.57 

0.61 

-0.65 

0.00 

0.46 

1.33 

K0086 

-0.64 

19 

16 

0.70 

1.03 

0.20 

2.19 

1.33 

0.00 

0.28 

0.76 

K0087 

-1.64 

18 

17 

1.09 

1.01 

0.28 

0.41 

-0.08 

0.00 

0.32 

1.07 

K0088 

-1.43 

18 

16 

0.81 

0.82 

-0.24 

0.44 

-0.04 

0.00 

0.41 

1.23 

K0089 

-1.19 

18 

17 

1.05 

0.79 

0.02 

0.36 

-0.14 

0.00 

0.34 

1.17 

K0090 

-1.52 

18 

17 

1.07 

1.07 

0.35 

0.63 

0.17 

0.00 

0.23 

1.00 

K0091 

-1.19 

18 

16 

0.96 

1.03 

0.27 

1.99 

1.07 

0.00 

0.43 

0.84 

K0092 

-0.67 

18 

15 

0.69 

1.11 

0.40 

1.03 

0.30 

0.00 

0.29 

0.87 

K0093 

-0.89 

18 

14 

0.70 

0.63 

-1.01 

0.38 

-0.23 

0.00 

0.68 

1.43 

K0094 

-2.03 

18 

17 

1.07 

1.15 

0.45 

1.11 

0.55 

0.00 

0.16 

0.89 

K0095 

-0.98 

19 

16 

0.67 

0.89 

-0.20 

0.65 

-0.30 

0.00 

0.39 

1.19 

K0096 

-1.02 

16 

14 

0.81 

0.75 

-0.40 

0.40 

-0.33 

0.00 

0.48 

1.28 

K0097 

-0.82 

18 

15 

0.79 

1.00 

0.16 

0.58 

-0.10 

0.00 

0.58 

1.07 

K0098 

0.00 

18 

13 

0.67 

1.45 

1.11 

2.56 

1.78 

0.00 

0.37 

0.45 

K0099 

-1.24 

19 

16 

0.83 

0.81 

-0.15 

0.94 

0.25 

0.00 

0.59 

1.08 

KOI 00 

-0.12 

19 

13 

0.57 

1.09 

0.43 

1.49 

1.25 

0.00 

0.37 

0.66 

KOlOl 

0.38 

17 

10 

0.64 

0.77 

-0.78 

0.63 

-0.76 

0.00 

0.68 

1.46 

KOI 02 

0.33 

18 

12 

0.67 

1.09 

0.36 

1.10 

0.36 

0.00 

0.61 

0.89 

KOI 03 

-2.85 

16 

15 

1.62 

0.14 

-0.69 

0.04 

-0.95 

0.00 

0.73 

1.34 

KOI 04 

0.40 

18 

11 

0.72 

0.91 

-0.10 

2.44 

1.74 

0.00 

0.68 

0.84 

KOI 05 

-0.99 

17 

15 

0.83 

0.64 

-0.63 

0.31 

-0.39 

0.00 

0.56 

1.33 

KOI 06 

-1.88 

17 

16 

1.07 

0.94 

0.19 

0.44 

-0.04 

0.00 

0.29 

1.09 

KOI 07 

-0.40 

18 

13 

0.60 

0.75 

-0.97 

0.59 

-0.68 

0.00 

0.57 

1.53 

KOI 08 

-0.80 

18 

15 

0.68 

1.12 

0.43 

0.95 

0.18 

0.00 

0.27 

0.90 

KOI 09 

-0.38 

18 

14 

0.71 

0.91 

-0.13 

0.66 

-0.17 

0.00 

0.59 

1.17 

KOllO 

0.74 

18 

12 

0.62 

0.87 

-0.40 

0.69 

-0.45 

0.00 

0.64 

1.27 

KOI 11 

-0.37 

17 

14 

0.69 

1.09 

0.36 

1.00 

0.23 

0.00 

0.30 

0.90 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KOI 12 

1.13 

19 

9 

0.54 

0.90 

-0.45 

0.81 

-0.48 

0.00 

0.54 

1.34 

K0113 

-0.24 

20 

15 

0.63 

0.92 

-0.16 

0.70 

-0.12 

0.00 

0.58 

1.14 

KOI 14 

-0.25 

18 

14 

0.64 

1.06 

0.32 

0.78 

-0.01 

0.00 

0.42 

0.97 

K0115 

-1.91 

18 

17 

1.06 

0.71 

-0.10 

0.23 

-0.34 

0.00 

0.42 

1.21 

K0116 

0.23 

116 

81 

0.22 

1.02 

0.24 

0.95 

-0.20 

0.00 

0.38 

0.98 

K0117 

-0.96 

18 

15 

0.70 

0.96 

0.06 

0.80 

-0.09 

0.00 

0.44 

1.05 

KOI 18 

-1.29 

18 

15 

0.93 

0.88 

0.06 

0.95 

0.30 

0.00 

0.68 

1.04 

K0119 

0.32 

20 

14 

0.67 

1.02 

0.18 

1.87 

1.33 

0.00 

0.62 

0.79 

KOI 20 

-0.67 

17 

15 

0.78 

0.96 

0.10 

0.84 

0.15 

0.00 

0.28 

1.04 

K0121 

-0.38 

19 

15 

0.67 

0.79 

-0.67 

0.48 

-0.33 

0.00 

0.61 

1.36 

KOI 22 

0.26 

16 

10 

0.61 

1.41 

1.51 

1.47 

0.90 

0.00 

0.32 

0.11 

KOI 23 

0.37 

18 

13 

0.61 

0.87 

-0.59 

0.81 

-0.14 

0.00 

0.53 

1.38 

KOI 24 

-0.36 

18 

15 

0.82 

1.01 

0.17 

0.94 

0.32 

0.00 

0.61 

0.97 

KOI 25 

-1.45 

18 

16 

0.81 

0.85 

-0.13 

0.50 

-0.15 

0.00 

0.40 

1.17 

KOI 26 

-0.68 

19 

16 

0.68 

0.89 

-0.16 

0.90 

0.16 

0.00 

0.36 

1.09 

KOI 27 

-0.40 

18 

14 

0.68 

0.67 

-0.80 

0.45 

-0.64 

0.00 

0.69 

1.38 

K0128 

0.26 

15 

9 

0.65 

0.90 

-0.33 

0.83 

0.03 

0.00 

0.60 

1.23 

KOI 29 

-1.15 

117 

105 

0.32 

0.91 

-0.32 

0.72 

-0.63 

0.00 

0.32 

1.08 

KOBO 

-0.24 

120 

87 

0.23 

1.26 

2.34 

1.25 

1.04 

0.00 

0.24 

0.55 

K0131 

0.11 

18 

11 

0.61 

0.84 

-0.61 

0.66 

-0.42 

0.00 

0.65 

1.36 

KOI 32 

0.62 

118 

76 

0.22 

0.89 

-1.20 

0.81 

-1.18 

0.00 

0.54 

1.25 

K0133 

-0.40 

18 

14 

0.70 

0.83 

-0.33 

1.58 

0.99 

0.00 

0.54 

1.03 

KOI 34 

0.36 

18 

13 

0.60 

0.79 

-0.61 

0.76 

-0.37 

0.00 

0.58 

1.30 

KOI 35 

1.14 

18 

11 

0.61 

0.72 

-0.95 

0.67 

-0.77 

0.00 

0.68 

1.49 

KOI 36 

0.29 

18 

13 

0.59 

0.87 

-0.45 

0.72 

-0.41 

0.00 

0.50 

1.32 

K0137 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0138 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0139 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

KOI 40 

-1.44 

19 

16 

0.71 

0.58 

-1.15 

0.31 

-0.39 

0.00 

0.60 

1.46 

K0141 

-2.17 

18 

17 

1.08 

1.29 

0.59 

3.86 

1.68 

0.00 

-0.11 

0.59 

KOI 42 

0.00 

17 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

KOI 43 

-2.37 

18 

16 

1.09 

0.84 

0.04 

0.29 

-0.25 

0.00 

0.67 

1.16 

KOI 44 

-1.70 

18 

14 

0.82 

0.99 

0.14 

0.71 

0.13 

0.00 

0.69 

1.03 

KOI 45 

0.26 

18 

13 

0.58 

1.15 

0.59 

1.21 

0.58 

0.00 

0.28 

0.74 

KOI 46 

0.00 

18 

13 

0.68 

0.88 

-0.33 

0.73 

-0.46 

0.00 

0.63 

1.31 

KOI 47 

-1.01 

18 

16 

0.80 

0.84 

-0.18 

0.53 

-0.20 

0.00 

0.42 

1.19 

KOI 48 

-1.98 

19 

18 

1.08 

0.65 

-0.22 

0.21 

-0.39 

0.00 

0.40 

1.25 

KOI 49 

-2.16 

18 

16 

1.09 

0.82 

0.01 

0.25 

-0.31 

0.00 

0.68 

1.17 

K0150 

-1.65 

18 

15 

0.77 

0.89 

-0.08 

0.58 

-0.02 

0.00 

0.58 

1.12 

K0151 

-1.67 

18 

16 

0.84 

0.65 

-0.71 

0.28 

-0.27 

0.00 

0.54 

1.37 

KOI 52 

-1.69 

116 

108 

0.38 

0.89 

-0.29 

0.43 

-1.00 

0.00 

0.34 

1.11 

K0153 

-0.64 

18 

14 

0.70 

1.05 

0.24 

0.71 

-0.05 

0.00 

0.58 

1.02 

KOI 54 

-1.85 

18 

15 

0.85 

0.62 

-0.69 

0.28 

-0.26 

0.00 

0.72 

1.36 

K0155 

-0.69 

17 

15 

0.88 

0.82 

-0.12 

0.75 

0.08 

0.00 

0.48 

1.12 

KOI 56 

-1.08 

117 

102 

0.29 

0.90 

-0.48 

0.87 

-0.29 

0.00 

0.35 

1.08 

K0157 

-1.23 

19 

16 

0.80 

1.06 

0.29 

1.14 

0.52 

0.00 

0.55 

0.92 

K0158 

-1.55 

17 

16 

1.06 

1.07 

0.36 

0.77 

0.29 

0.00 

0.19 

0.97 

KOI 59 

-2.89 

18 

17 

1.22 

0.35 

-0.75 

0.09 

-0.71 

0.00 

0.58 

1.34 

KOI 60 

-1.35 

19 

15 

0.70 

1.33 

0.94 

0.83 

0.23 

0.00 

0.46 

0.75 

K0161 

-0.83 

18 

16 

0.88 

0.79 

-0.15 

0.69 

-0.09 

0.00 

0.50 

1.15 

KOI 62 

-1.74 

18 

17 

1.12 

0.49 

-0.50 

0.15 

-0.53 

0.00 

0.49 

1.31 

KOI 63 

-0.24 

18 

15 

0.77 

1.13 

0.42 

0.71 

-0.06 

0.00 

0.50 

0.97 

KOI 64 

-1.96 

18 

17 

1.06 

0.96 

0.23 

0.53 

0.06 

0.00 

0.26 

1.07 

KOI 65 

-0.89 

17 

14 

0.87 

1.37 

0.87 

0.78 

0.27 

0.00 

0.59 

0.76 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KOI 66 

-1.30 

19 

16 

0.75 

0.85 

-0.19 

0.50 

-0.14 

0.00 

0.55 

1.18 

KOI 67 

-0.27 

18 

13 

0.70 

0.77 

-0.50 

0.54 

-0.49 

0.00 

0.70 

1.32 

KOI 68 

0.32 

18 

13 

0.63 

0.67 

-1.01 

0.49 

-0.85 

0.00 

0.71 

1.46 

KOI 69 

0.14 

19 

14 

0.66 

0.81 

-0.43 

0.54 

-0.60 

0.00 

0.67 

1.28 

KOI 70 

-1.76 

116 

108 

0.38 

0.93 

-0.14 

0.63 

-0.57 

0.00 

0.27 

1.06 

K0171 

0.69 

19 

11 

0.54 

0.87 

-0.49 

0.77 

-0.69 

0.00 

0.59 

1.32 

KOI 72 

0.37 

17 

12 

0.72 

1.04 

0.23 

1.88 

1.16 

0.00 

0.60 

0.79 

KOI 73 

1.06 

19 

11 

0.62 

1.09 

0.43 

1.01 

0.16 

0.00 

0.63 

0.85 

KOI 74 

0.98 

18 

12 

0.63 

0.79 

-0.78 

0.57 

-0.56 

0.00 

0.69 

1.46 

KOI 75 

1.42 

18 

11 

0.55 

0.73 

-1.20 

0.67 

-1.09 

0.00 

0.66 

1.64 

KOI 76 

1.09 

18 

8 

0.55 

0.91 

-0.36 

1.08 

0.35 

0.00 

0.51 

1.13 

KOI 77 

0.08 

18 

13 

0.61 

1.26 

0.95 

1.67 

1.15 

0.00 

0.28 

0.44 

KOI 78 

-0.84 

18 

15 

0.83 

0.97 

0.10 

0.44 

-0.11 

0.00 

0.65 

1.12 

KOI 79 

-1.17 

21 

17 

0.64 

0.70 

-0.76 

0.45 

-0.58 

0.00 

0.57 

1.35 

KOI 80 

-1.32 

19 

17 

0.81 

1.01 

0.19 

0.49 

0.03 

0.00 

0.37 

1.07 

KOI 81 

-0.08 

18 

14 

0.65 

0.58 

-1.52 

0.39 

-0.87 

0.00 

0.66 

1.63 

KOI 82 

-0.92 

18 

15 

0.73 

0.75 

-0.49 

0.48 

-0.64 

0.00 

0.55 

1.30 

KOI 83 

-1.00 

17 

14 

0.86 

1.24 

0.63 

0.77 

0.30 

0.00 

0.60 

0.83 

KOI 84 

-2.03 

18 

16 

1.07 

1.18 

0.48 

1.23 

0.62 

0.00 

0.53 

0.85 

KOI 85 

-0.26 

17 

14 

0.69 

1.05 

0.25 

0.72 

-0.20 

0.00 

0.37 

1.03 

KOI 86 

-0.38 

122 

97 

0.25 

0.77 

-1.75 

0.68 

-1.12 

0.00 

0.57 

1.27 

KOI 87 

-1.49 

18 

16 

0.80 

1.23 

0.58 

0.94 

0.33 

0.00 

0.20 

0.85 

KOI 88 

-0.93 

19 

16 

0.82 

0.73 

-0.47 

0.35 

-0.27 

0.00 

0.69 

1.31 

KOI 89 

-0.60 

18 

13 

0.64 

1.04 

0.22 

0.84 

0.07 

0.00 

0.53 

0.98 

KOI 90 

-1.23 

18 

15 

0.95 

0.58 

-0.49 

0.25 

-0.52 

0.00 

0.79 

1.30 

K0191 

-1.60 

19 

18 

1.07 

0.83 

0.06 

0.29 

-0.25 

0.00 

0.38 

1.15 

KOI 92 

0.77 

18 

11 

0.60 

0.77 

-1.04 

0.68 

-0.44 

0.00 

0.65 

1.59 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KOI 93 

-0.51 

17 

14 

0.69 

0.83 

-0.37 

0.56 

-0.43 

0.00 

0.47 

1.26 

KOI 94 

0.22 

19 

13 

0.64 

0.69 

-1.01 

0.52 

-0.84 

0.00 

0.71 

1.53 

KOI 95 

-0.63 

18 

15 

0.77 

1.53 

1.16 

4.61 

2.27 

0.00 

0.15 

0.11 

KOI 96 

1.79 

18 

9 

0.53 

1.10 

0.54 

1.15 

0.64 

0.00 

0.39 

0.68 

KOI 97 

0.71 

18 

12 

0.57 

1.08 

0.37 

1.24 

0.67 

0.00 

0.40 

0.79 

KOI 98 

3.59 

18 

4 

0.71 

1.02 

0.18 

0.74 

-0.05 

0.00 

0.49 

1.01 

KOI 99 

-0.20 

18 

13 

0.63 

1.12 

0.51 

0.79 

-0.03 

0.00 

0.51 

0.91 

K0200 

-0.31 

17 

13 

0.70 

0.92 

-0.10 

1.66 

0.90 

0.00 

0.52 

0.91 

K0301 

-0.80 

18 

16 

0.83 

0.67 

-0.55 

0.31 

-0.67 

0.00 

0.56 

1.31 

K0302 

-0.30 

18 

14 

0.68 

0.62 

-1.29 

0.38 

-0.64 

0.00 

0.66 

1.56 

K0303 

-0.40 

18 

14 

0.63 

1.46 

1.44 

1.51 

0.89 

0.00 

0.16 

0.26 

K0304 

0.72 

18 

11 

0.56 

0.96 

-0.10 

0.88 

-0.29 

0.00 

0.51 

1.15 

K0305 

0.51 

24 

14 

0.52 

1.32 

1.24 

2.30 

2.17 

0.00 

0.43 

0.34 

K0306 

-1.75 

117 

108 

0.37 

0.94 

-0.14 

0.82 

-0.21 

0.00 

0.29 

1.04 

K0307 

-0.92 

18 

16 

0.84 

0.97 

0.11 

0.54 

-0.30 

0.00 

0.42 

1.13 

K0308 

-0.46 

17 

13 

0.64 

1.12 

0.50 

1.26 

0.58 

0.00 

0.32 

0.73 

K0309 

-0.04 

18 

13 

0.61 

0.65 

-1.40 

0.49 

-1.11 

0.00 

0.65 

1.66 

K0310 

3.21 

18 

5 

0.85 

0.91 

0.02 

1.20 

0.60 

0.00 

0.70 

0.97 

K0311 

2.66 

17 

7 

0.61 

0.90 

-0.31 

0.72 

-0.52 

0.00 

0.65 

1.28 

K0312 

0.21 

18 

15 

0.70 

1.10 

0.40 

1.87 

1.30 

0.00 

0.28 

0.70 

K0313 

-0.44 

19 

15 

0.67 

0.98 

0.07 

0.91 

0.10 

0.00 

0.52 

1.03 

K0314 

-0.60 

18 

15 

0.79 

1.09 

0.34 

1.02 

0.33 

0.00 

0.51 

0.93 

K0315 

0.30 

18 

13 

0.61 

1.45 

1.68 

1.29 

0.68 

0.00 

0.30 

0.13 

K0316 

-1.67 

17 

15 

0.81 

0.69 

-0.46 

0.38 

-0.61 

0.00 

0.50 

1.27 

K0317 

-1.78 

18 

17 

1.07 

1.16 

0.46 

0.97 

0.45 

0.00 

0.13 

0.89 

K0318 

-1.89 

19 

16 

0.79 

1.34 

0.90 

0.58 

0.12 

0.00 

0.50 

0.82 

K0319 

0.00 

17 

0 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0320 

1.17 

18 

9 

0.53 

1.04 

0.26 

0.95 

-0.04 

0.00 

0.45 

0.95 

K0321 

0.38 

18 

11 

0.57 

1.08 

0.45 

1.02 

0.16 

0.00 

0.47 

0.80 

K0322 

0.87 

18 

11 

0.59 

0.95 

-0.07 

1.05 

0.26 

0.00 

0.57 

1.04 

K0323 

1.61 

18 

8 

0.59 

1.06 

0.31 

1.18 

0.53 

0.00 

0.56 

0.83 

K0324 

-0.79 

19 

14 

0.72 

1.22 

0.61 

1.99 

1.20 

0.00 

0.56 

0.67 

K0325 

2.01 

18 

8 

0.59 

0.91 

-0.32 

0.95 

0.09 

0.00 

0.60 

1.15 

K0326 

0.65 

18 

12 

0.57 

0.86 

-0.55 

0.74 

-0.68 

0.00 

0.54 

1.39 

K0327 

0.53 

18 

12 

0.65 

1.11 

0.41 

0.92 

0.07 

0.00 

0.59 

0.92 

K0328 

1.60 

19 

8 

0.63 

0.79 

-0.61 

0.89 

0.00 

0.00 

0.72 

1.25 

K0329 

0.34 

19 

13 

0.56 

1.18 

0.82 

1.10 

0.36 

0.00 

0.34 

0.67 

K0330 

-1.17 

19 

16 

0.81 

0.49 

-1.06 

0.20 

-0.41 

0.00 

0.74 

1.40 

K0331 

2.74 

17 

6 

0.66 

1.42 

1.23 

2.28 

1.89 

0.00 

0.37 

0.24 

K0332 

1.89 

17 

8 

0.55 

1.06 

0.33 

1.02 

0.16 

0.00 

0.43 

0.88 

K0333 

2.78 

18 

6 

0.60 

0.72 

-1.08 

0.56 

-0.51 

0.00 

0.66 

1.53 

K0334 

0.22 

19 

13 

0.60 

0.81 

-0.67 

0.65 

-0.44 

0.00 

0.62 

1.36 

K0335 

3.38 

23 

5 

0.72 

0.71 

-0.58 

0.39 

-0.38 

0.00 

0.74 

1.27 

K0336 

0.61 

17 

10 

0.66 

1.22 

0.74 

0.97 

0.13 

0.00 

0.61 

0.77 

K0337 

-0.27 

18 

15 

0.68 

1.03 

0.22 

0.82 

-0.01 

0.00 

0.35 

1.01 

K0338 

1.99 

18 

8 

0.61 

1.72 

1.95 

2.21 

2.13 

0.00 

0.30 

-0.10 

K0339 

0.92 

18 

14 

0.67 

0.96 

0.02 

0.89 

-0.04 

0.00 

0.53 

1.06 

K0340 

0.69 

18 

11 

0.57 

1.15 

0.69 

1.12 

0.44 

0.00 

0.44 

0.67 

K0341 

-0.28 

17 

13 

0.62 

1.27 

0.94 

1.19 

0.50 

0.00 

0.20 

0.60 

K0342 

-2.15 

18 

17 

1.14 

1.51 

0.84 

2.40 

1.19 

0.00 

0.08 

0.53 

K0343 

-0.65 

17 

14 

0.81 

0.69 

-0.54 

0.40 

-0.40 

0.00 

0.68 

1.33 

K0344 

-1.74 

18 

16 

0.81 

1.10 

0.36 

0.65 

0.12 

0.00 

0.33 

0.98 

K0345 

-1.26 

17 

14 

0.83 

1.25 

0.67 

1.43 

0.74 

0.00 

0.51 

0.64 

K0346 

-0.47 

17 

15 

0.84 

0.73 

-0.41 

0.35 

-0.43 

0.00 

0.59 

1.26 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0347 

0.18 

18 

13 

0.60 

1.18 

0.68 

1.60 

1.13 

0.00 

0.32 

0.60 

K0348 

-0.36 

18 

14 

0.69 

0.55 

-1.31 

0.35 

-0.86 

0.00 

0.72 

1.54 

K0349 

0.67 

18 

12 

0.61 

1.56 

1.84 

1.45 

0.88 

0.00 

0.34 

0.08 

K0350 

-1.48 

17 

12 

0.67 

1.01 

0.16 

0.76 

-0.16 

0.00 

0.62 

1.05 

K0351 

-0.18 

20 

16 

0.65 

0.85 

-0.33 

0.54 

-0.53 

0.00 

0.60 

1.23 

K0352 

-1.35 

18 

16 

0.79 

0.74 

-0.36 

0.37 

-0.32 

0.00 

0.50 

1.25 

K0353 

-1.63 

19 

17 

0.86 

0.66 

-0.48 

0.31 

-0.22 

0.00 

0.54 

1.27 

K0354 

0.31 

18 

11 

0.65 

0.96 

-0.02 

0.69 

-0.30 

0.00 

0.68 

1.13 

K0355 

-2.25 

17 

15 

0.95 

1.00 

0.23 

1.68 

0.87 

0.00 

0.44 

0.88 

K0356 

-0.07 

18 

13 

0.63 

0.46 

-2.13 

0.32 

-1.02 

0.00 

0.74 

1.77 

K0357 

-0.16 

18 

15 

0.65 

1.17 

0.52 

1.44 

0.90 

0.00 

-0.10 

0.78 

K0358 

0.00 

18 

0 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0359 

0.93 

18 

11 

0.58 

1.07 

0.38 

1.03 

0.19 

0.00 

0.50 

0.84 

K0360 

0.13 

18 

12 

0.66 

0.79 

-0.67 

0.61 

-0.58 

0.00 

0.69 

1.40 

K0361 

-1.10 

17 

15 

0.89 

0.65 

-0.47 

0.36 

-0.15 

0.00 

0.56 

1.29 

K0362 

-1.04 

17 

13 

0.77 

0.44 

-1.46 

0.25 

-0.69 

0.00 

0.78 

1.56 

K0363 

0.86 

18 

12 

0.59 

0.91 

-0.21 

0.73 

-0.53 

0.00 

0.59 

1.20 

K0364 

0.92 

18 

11 

0.57 

1.10 

0.52 

1.11 

0.41 

0.00 

0.46 

0.73 

K0365 

0.72 

18 

14 

0.67 

0.47 

-1.71 

0.34 

-1.52 

0.00 

0.77 

1.67 

K0366 

1.69 

18 

9 

0.59 

0.71 

-1.12 

0.58 

-0.69 

0.00 

0.65 

1.61 

K0367 

2.25 

18 

7 

0.64 

1.00 

0.12 

0.88 

-0.01 

0.00 

0.65 

1.02 

K0368 

-0.99 

17 

14 

0.93 

0.34 

-1.16 

0.15 

-0.90 

0.00 

0.83 

1.42 

K0369 

-1.38 

19 

16 

0.73 

0.56 

-1.14 

0.30 

-0.42 

0.00 

0.62 

1.48 

K0370 

1.86 

17 

7 

0.57 

1.38 

1.45 

1.66 

1.62 

0.00 

0.19 

0.13 

K0371 

1.16 

18 

10 

0.56 

1.06 

0.32 

1.03 

0.19 

0.00 

0.50 

0.86 

K0372 

1.67 

17 

10 

0.58 

1.12 

0.63 

1.04 

0.43 

0.00 

0.45 

0.62 

K0373 

0.00 

18 

12 

0.63 

0.77 

-0.61 

0.60 

-0.67 

0.00 

0.72 

1.32 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0374 

-2.10 

17 

16 

1.10 

1.20 

0.50 

0.83 

0.34 

0.00 

0.21 

0.88 

K0375 

-1.34 

19 

16 

0.71 

0.82 

-0.38 

0.54 

-0.03 

0.00 

0.47 

1.25 

K0376 

0.22 

18 

13 

0.64 

0.75 

-0.82 

0.53 

-0.66 

0.00 

0.66 

1.42 

K0377 

0.81 

18 

11 

0.59 

1.06 

0.32 

1.12 

0.42 

0.00 

0.52 

0.85 

K0378 

1.82 

18 

9 

0.59 

1.28 

1.11 

1.33 

0.97 

0.00 

0.45 

0.35 

K0379 

-0.66 

18 

15 

0.71 

0.91 

-0.12 

0.60 

-0.07 

0.00 

0.48 

1.16 

K0380 

1.44 

18 

10 

0.56 

1.94 

3.03 

2.09 

2.53 

0.00 

-0.02 

-0.92 

K0381 

0.09 

18 

14 

0.74 

1.00 

0.16 

0.63 

-0.27 

0.00 

0.63 

1.09 

K0382 

-0.20 

19 

14 

0.69 

1.39 

1.26 

1.20 

0.51 

0.00 

0.55 

0.36 

K0383 

1.05 

17 

11 

0.61 

1.40 

1.38 

1.70 

1.40 

0.00 

0.30 

0.21 

K0384 

1.70 

18 

8 

0.63 

1.01 

0.14 

0.94 

0.06 

0.00 

0.66 

1.00 

K0385 

1.11 

17 

9 

0.57 

1.34 

1.38 

1.40 

1.19 

0.00 

0.30 

0.18 

K0386 

-0.95 

116 

101 

0.30 

1.09 

0.54 

1.17 

0.51 

0.00 

0.26 

0.90 

K0387 

0.27 

19 

13 

0.60 

1.02 

0.15 

0.84 

-0.16 

0.00 

0.55 

1.03 

K0388 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0389 

0.79 

118 

63 

0.21 

0.95 

-0.63 

1.03 

0.24 

0.00 

0.45 

1.11 

K0390 

-1.01 

19 

15 

0.68 

0.87 

-0.29 

0.62 

-0.01 

0.00 

0.56 

1.22 

K0391 

-1.43 

19 

17 

0.92 

0.55 

-0.57 

0.21 

-0.38 

0.00 

0.66 

1.30 

K0392 

2.22 

18 

7 

0.67 

1.18 

0.58 

1.13 

0.42 

0.00 

0.62 

0.79 

K0393 

0.20 

18 

12 

0.63 

1.06 

0.29 

0.78 

-0.15 

0.00 

0.59 

1.00 

K0394 

0.78 

18 

10 

0.55 

1.20 

0.92 

1.15 

0.54 

0.00 

0.39 

0.56 

K0395 

-1.34 

19 

17 

0.79 

1.18 

0.50 

1.07 

0.38 

0.00 

0.17 

0.85 

K0396 

-0.40 

18 

13 

0.67 

0.62 

-1.38 

0.42 

-0.61 

0.00 

0.71 

1.63 

K0397 

-1.87 

18 

16 

1.05 

1.03 

0.32 

0.79 

0.31 

0.00 

0.55 

0.99 

K0398 

-0.29 

19 

14 

0.62 

0.54 

-1.87 

0.39 

-0.89 

0.00 

0.70 

1.74 

K0399 

0.68 

17 

9 

0.62 

1.23 

0.91 

1.22 

0.65 

0.00 

0.51 

0.52 

K0400 

-1.99 

18 

17 

1.07 

1.07 

0.36 

0.60 

0.14 

0.00 

0.25 

1.01 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0401 

-0.82 

18 

15 

0.69 

1.07 

0.31 

6.75 

3.00 

0.00 

0.10 

0.49 

K0402 

-0.06 

18 

14 

0.67 

0.91 

-0.14 

0.74 

-0.16 

0.00 

0.53 

1.14 

K0403 

-1.24 

18 

16 

0.95 

0.98 

0.19 

1.03 

0.49 

0.00 

0.49 

0.97 

K0404 

0.29 

17 

12 

0.66 

1.45 

1.39 

1.86 

1.29 

0.00 

0.39 

0.17 

K0405 

-1.43 

19 

16 

0.76 

0.68 

-0.64 

0.35 

-0.32 

0.00 

0.60 

1.34 

K0406 

-1.18 

19 

15 

0.68 

0.74 

-0.68 

0.46 

-0.02 

0.00 

0.60 

1.36 

K0407 

0.00 

18 

11 

0.59 

0.91 

-0.30 

0.73 

-0.35 

0.00 

0.59 

1.26 

K0408 

-0.08 

18 

13 

0.58 

1.09 

0.48 

0.89 

0.06 

0.00 

0.37 

0.85 

K0409 

2.45 

116 

34 

0.24 

1.23 

1.75 

2.31 

4.21 

0.00 

0.33 

0.54 

K0410 

0.61 

17 

12 

0.66 

1.06 

0.27 

0.82 

-0.10 

0.00 

0.57 

0.99 

K0411 

2.31 

18 

8 

0.56 

1.12 

0.62 

1.32 

1.09 

0.00 

0.39 

0.54 

K0412 

2.98 

18 

6 

0.83 

0.94 

0.06 

1.87 

1.02 

0.00 

0.69 

0.88 

K0413 

1.21 

17 

9 

0.66 

0.66 

-1.00 

0.47 

-1.10 

0.00 

0.80 

1.49 

K0414 

-0.83 

18 

14 

0.68 

1.20 

0.64 

1.19 

0.49 

0.00 

0.45 

0.73 

K0415 

-0.26 

18 

14 

0.75 

1.01 

0.16 

0.72 

-0.10 

0.00 

0.62 

1.06 

K0416 

0.32 

18 

14 

0.69 

1.20 

0.63 

2.26 

1.55 

0.00 

0.39 

0.62 

K0417 

1.50 

20 

9 

0.55 

1.41 

1.58 

1.57 

1.20 

0.00 

0.37 

0.18 

K0418 

1.63 

16 

7 

0.66 

0.96 

-0.05 

0.85 

0.09 

0.00 

0.64 

1.09 

K0419 

-0.37 

19 

16 

0.67 

1.03 

0.21 

0.80 

-0.11 

0.00 

0.30 

1.02 

K0420 

-0.40 

18 

14 

0.70 

0.98 

0.06 

0.74 

-0.20 

0.00 

0.57 

1.10 

K0421 

-0.34 

18 

12 

0.65 

1.26 

0.90 

1.43 

0.75 

0.00 

0.52 

0.57 

K0422 

-1.06 

18 

15 

0.90 

1.51 

0.91 

0.69 

0.14 

0.00 

0.61 

0.83 

K0423 

0.46 

121 

81 

0.22 

0.90 

-0.98 

0.97 

-0.14 

0.00 

0.51 

1.15 

K0424 

0.11 

19 

12 

0.58 

0.74 

-0.95 

0.57 

-0.79 

0.00 

0.67 

1.48 

K0425 

0.05 

17 

12 

0.69 

1.05 

0.26 

1.29 

0.62 

0.00 

0.58 

0.88 

K0426 

-1.84 

19 

17 

0.90 

0.75 

-0.20 

0.45 

-0.05 

0.00 

0.51 

1.18 

K0427 

-0.44 

18 

15 

0.67 

0.84 

-0.33 

0.64 

-0.18 

0.00 

0.41 

1.21 



easyCBM CCSS Kindergarten Math Measure Development 


173 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0428 

-0.67 

16 

13 

0.86 

1.58 

1.03 

1.25 

0.55 

0.00 

0.45 

0.62 

K0429 

-0.48 

18 

13 

0.60 

1.06 

0.29 

0.85 

-0.05 

0.00 

0.43 

0.98 

K0430 

-1.65 

18 

16 

0.89 

0.56 

-0.78 

0.24 

-0.33 

0.00 

0.59 

1.37 

K0431 

0.87 

16 

10 

0.59 

0.72 

-1.35 

0.64 

-1.15 

0.00 

0.64 

1.86 

K0432 

1.14 

18 

11 

0.66 

0.76 

-0.62 

0.52 

-0.77 

0.00 

0.77 

1.35 

K0433 

0.38 

16 

10 

0.66 

1.52 

1.46 

1.46 

0.87 

0.00 

0.41 

0.29 

K0434 

1.04 

18 

10 

0.59 

1.12 

0.58 

1.30 

0.87 

0.00 

0.53 

0.51 

K0435 

1.20 

18 

8 

0.52 

1.19 

1.12 

1.20 

0.88 

0.00 

0.27 

0.25 

K0436 

-1.14 

18 

16 

0.84 

0.73 

-0.41 

0.30 

-0.38 

0.00 

0.55 

1.27 

K0437 

-1.17 

17 

15 

0.81 

0.55 

-0.87 

0.28 

-0.59 

0.00 

0.56 

1.40 

K0438 

-1.93 

19 

15 

0.88 

1.36 

0.82 

1.66 

0.86 

0.00 

0.64 

0.63 

K0439 

-0.25 

19 

15 

0.65 

0.71 

-0.89 

0.54 

-0.48 

0.00 

0.58 

1.43 

K0440 

-1.81 

19 

17 

0.81 

0.85 

-0.17 

0.39 

-0.12 

0.00 

0.45 

1.19 

K0441 

-0.41 

18 

14 

0.69 

0.77 

-0.59 

0.48 

-0.38 

0.00 

0.64 

1.34 

K0442 

-1.66 

17 

15 

0.83 

0.71 

-0.49 

0.33 

-0.30 

0.00 

0.54 

1.30 

K0443 

-0.92 

18 

14 

0.75 

0.50 

-1.36 

0.28 

-0.46 

0.00 

0.76 

1.53 

K0444 

1.48 

18 

9 

0.60 

1.27 

1.07 

1.18 

0.51 

0.00 

0.51 

0.44 

K0445 

1.50 

17 

7 

0.58 

1.12 

0.57 

1.11 

0.38 

0.00 

0.45 

0.72 

K0446 

2.09 

18 

9 

0.61 

1.23 

0.93 

1.81 

1.44 

0.00 

0.50 

0.35 

K0447 

-0.10 

17 

11 

0.62 

1.06 

0.30 

0.83 

-0.20 

0.00 

0.56 

1.00 

K0448 

0.42 

16 

11 

0.69 

1.24 

0.76 

1.08 

0.34 

0.00 

0.52 

0.73 

K0449 

0.55 

19 

9 

0.58 

1.12 

0.49 

1.05 

0.25 

0.00 

0.54 

0.84 

K0450 

0.03 

18 

12 

0.63 

0.87 

-0.34 

0.65 

-0.55 

0.00 

0.62 

1.27 

K0451 

1.86 

19 

8 

0.56 

1.23 

0.97 

1.10 

0.39 

0.00 

0.45 

0.56 

K0452 

2.02 

15 

5 

0.71 

1.17 

0.57 

1.20 

0.54 

0.00 

0.51 

0.68 

K0453 

0.52 

17 

9 

0.57 

0.97 

-0.05 

0.95 

-0.03 

0.00 

0.53 

1.07 

K0454 

2.06 

18 

7 

0.62 

0.76 

-0.77 

0.69 

-0.27 

0.00 

0.69 

1.39 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0455 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0456 

-0.06 

21 

16 

0.59 

0.79 

-0.73 

0.58 

-0.59 

0.00 

0.57 

1.37 

K0457 

0.44 

17 

11 

0.64 

1.08 

0.39 

1.20 

0.51 

0.00 

0.54 

0.77 

K0458 

-1.43 

16 

15 

1.13 

1.36 

0.68 

1.13 

0.56 

0.00 

0.18 

0.75 

K0459 

0.20 

15 

12 

0.75 

1.20 

0.65 

1.89 

1.17 

0.00 

0.33 

0.58 

K0460 

-0.16 

18 

15 

0.71 

0.74 

-0.66 

0.46 

-0.50 

0.00 

0.56 

1.34 

K0461 

0.63 

18 

10 

0.55 

1.18 

0.83 

1.20 

0.72 

0.00 

0.37 

0.54 

K0462 

-1.00 

18 

15 

0.72 

0.48 

-1.54 

0.26 

-0.55 

0.00 

0.65 

1.56 

K0463 

-1.39 

18 

16 

0.88 

0.61 

-0.53 

0.29 

-0.29 

0.00 

0.60 

1.29 

K0464 

-1.95 

18 

16 

1.06 

0.85 

0.09 

0.38 

-0.12 

0.00 

0.65 

1.14 

K0465 

0.05 

19 

13 

0.60 

1.12 

0.51 

1.13 

0.41 

0.00 

0.48 

0.80 

K0466 

-0.33 

18 

15 

0.74 

0.90 

-0.11 

3.43 

2.07 

0.00 

0.38 

0.78 

K0467 

1.23 

18 

11 

0.61 

1.16 

0.80 

1.16 

0.62 

0.00 

0.52 

0.46 

K0468 

1.23 

18 

8 

0.59 

1.35 

1.24 

1.30 

0.73 

0.00 

0.45 

0.37 

K0469 

0.21 

18 

12 

0.55 

1.08 

0.45 

1.00 

0.13 

0.00 

0.35 

0.83 

K0470 

0.14 

19 

13 

0.65 

1.47 

1.38 

1.75 

1.13 

0.00 

0.47 

0.32 

K0471 

-2.36 

18 

17 

1.16 

0.43 

-0.63 

0.12 

-0.60 

0.00 

0.52 

1.34 

K0472 

0.04 

18 

14 

0.62 

1.02 

0.15 

0.92 

0.06 

0.00 

0.36 

0.99 

K0473 

0.18 

20 

13 

0.54 

1.02 

0.17 

1.09 

0.38 

0.00 

0.45 

0.93 

K0474 

0.25 

18 

14 

0.64 

0.68 

-0.94 

0.50 

-0.93 

0.00 

0.69 

1.42 

K0475 

-0.03 

18 

12 

0.59 

0.72 

-1.17 

0.54 

-0.87 

0.00 

0.66 

1.58 

K0476 

-0.21 

18 

13 

0.70 

0.92 

-0.05 

1.22 

0.53 

0.00 

0.61 

1.01 

K0477 

-0.81 

17 

12 

0.66 

1.11 

0.50 

0.85 

0.18 

0.00 

0.55 

0.85 

K0478 

0.98 

115 

67 

0.21 

1.02 

0.21 

0.99 

-0.06 

0.00 

0.44 

0.97 

K0479 

-0.72 

17 

14 

0.74 

1.40 

0.91 

1.51 

0.79 

0.00 

0.23 

0.62 

K0480 

0.31 

19 

12 

0.56 

0.85 

-0.49 

0.73 

-0.63 

0.00 

0.63 

1.28 

K0481 

-1.06 

19 

16 

0.68 

0.78 

-0.51 

0.48 

-0.28 

0.00 

0.46 

1.29 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0482 

-0.34 

16 

14 

0.82 

0.65 

-0.67 

0.35 

-0.43 

0.00 

0.57 

1.37 

K0483 

0.22 

18 

14 

0.64 

0.89 

-0.24 

0.86 

0.00 

0.00 

0.49 

1.13 

K0484 

-0.66 

18 

12 

0.69 

1.00 

0.09 

0.83 

0.06 

0.00 

0.67 

1.04 

K0485 

-2.16 

18 

17 

1.11 

1.46 

0.77 

9.90 

3.46 

0.00 

-0.26 

0.25 

K0486 

0.25 

17 

12 

0.66 

0.81 

-0.52 

0.82 

-0.14 

0.00 

0.61 

1.26 

K0487 

1.50 

17 

10 

0.62 

2.06 

2.82 

2.16 

2.36 

0.00 

0.12 

-0.77 

K0488 

0.00 

17 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0489 

-1.00 

18 

16 

0.90 

0.64 

-0.48 

0.30 

-0.24 

0.00 

0.61 

1.28 

K0490 

-1.48 

18 

16 

0.91 

1.09 

0.34 

1.97 

1.01 

0.00 

0.38 

0.73 

K0491 

0.33 

18 

13 

0.71 

0.57 

-1.23 

0.39 

-0.90 

0.00 

0.76 

1.56 

K0492 

-1.14 

19 

17 

0.82 

0.91 

-0.05 

0.53 

-0.16 

0.00 

0.42 

1.15 

K0493 

0.97 

18 

9 

0.60 

1.52 

1.78 

2.24 

2.56 

0.00 

0.36 

-0.35 

K0494 

1.11 

17 

7 

0.60 

1.30 

1.19 

1.38 

0.83 

0.00 

0.42 

0.36 

K0495 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0496 

-0.35 

19 

14 

0.73 

0.80 

-0.37 

0.53 

-0.31 

0.00 

0.71 

1.26 

K0497 

0.49 

17 

12 

0.58 

0.82 

-0.66 

0.71 

-0.59 

0.00 

0.55 

1.37 

K0498 

-0.35 

18 

15 

0.68 

0.81 

-0.38 

0.68 

-0.30 

0.00 

0.43 

1.22 

K0499 

0.01 

116 

83 

0.22 

1.19 

1.80 

1.19 

1.11 

0.00 

0.22 

0.64 

K0500 

1.35 

17 

10 

0.62 

0.65 

-1.29 

0.61 

-0.90 

0.00 

0.74 

1.60 

K0501 

-1.47 

18 

16 

0.78 

0.83 

-0.16 

0.53 

-0.20 

0.00 

0.33 

1.18 

K0502 

-2.37 

19 

17 

1.12 

1.04 

0.31 

0.37 

-0.13 

0.00 

0.61 

1.07 

K0503 

-1.15 

18 

15 

0.68 

0.91 

-0.09 

0.70 

-0.41 

0.00 

0.36 

1.15 

K0504 

0.83 

17 

10 

0.65 

1.07 

0.32 

1.07 

0.30 

0.00 

0.60 

0.89 

K0505 

0.29 

18 

11 

0.55 

0.55 

-2.17 

0.45 

-1.59 

0.00 

0.79 

1.91 

K0506 

-1.18 

18 

15 

0.70 

0.77 

-0.53 

0.45 

-0.50 

0.00 

0.57 

1.29 

K0507 

-0.60 

18 

14 

0.79 

0.42 

-1.63 

0.24 

-0.79 

0.00 

0.77 

1.60 

K0508 

-0.47 

18 

15 

0.71 

1.18 

0.57 

1.17 

0.48 

0.00 

0.31 

0.79 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0509 

-0.03 

17 

13 

0.66 

1.18 

0.61 

1.20 

0.50 

0.00 

0.36 

0.76 

K0510 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0511 

-0.26 

18 

16 

0.78 

0.75 

-0.34 

0.39 

-0.42 

0.00 

0.47 

1.25 

K0512 

2.73 

16 

7 

0.61 

1.09 

0.41 

0.97 

0.04 

0.00 

0.54 

0.88 

K0513 

-0.68 

18 

15 

0.76 

0.92 

-0.03 

0.68 

-0.08 

0.00 

0.54 

1.11 

K0514 

-0.43 

17 

14 

0.71 

1.74 

1.69 

5.85 

3.11 

0.00 

-0.34 

-0.18 

K0515 

-0.71 

19 

17 

0.80 

0.93 

0.03 

0.55 

-0.10 

0.00 

0.38 

1.11 

K0516 

0.38 

17 

12 

0.63 

0.79 

-0.64 

0.59 

-0.67 

0.00 

0.64 

1.37 

K0517 

-0.15 

16 

12 

0.70 

1.09 

0.35 

0.99 

0.19 

0.00 

0.53 

0.91 

K0518 

-0.12 

18 

13 

0.61 

1.65 

2.04 

1.48 

0.80 

0.00 

0.16 

0.02 

K0519 

-0.14 

19 

13 

0.59 

0.80 

-0.73 

0.64 

-0.72 

0.00 

0.61 

1.40 

K0520 

-0.43 

18 

14 

0.62 

1.26 

0.83 

0.96 

0.14 

0.00 

0.25 

0.78 

K0521 

-0.41 

17 

15 

0.80 

1.36 

0.81 

5.29 

2.33 

0.00 

-0.07 

0.32 

K0522 

0.35 

18 

12 

0.55 

0.99 

0.03 

0.86 

-0.27 

0.00 

0.41 

1.10 

K0523 

0.02 

18 

11 

0.63 

0.57 

-1.77 

0.44 

-0.88 

0.00 

0.74 

1.81 

K0524 

-1.54 

18 

15 

0.93 

2.20 

1.72 

5.87 

2.28 

0.00 

0.36 

-0.11 

K0525 

0.00 

18 

18 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0526 

0.33 

18 

13 

0.59 

1.14 

0.58 

1.27 

0.65 

0.00 

0.31 

0.73 

K0527 

-1.19 

18 

16 

0.80 

1.05 

0.26 

0.73 

0.06 

0.00 

0.31 

1.01 

K0528 

0.58 

18 

12 

0.56 

1.05 

0.29 

0.99 

0.06 

0.00 

0.39 

0.91 

K0529 

1.14 

19 

12 

0.63 

1.63 

1.78 

1.76 

1.56 

0.00 

0.43 

0.02 

K0530 

-0.35 

18 

13 

0.60 

0.96 

-0.14 

0.82 

-0.24 

0.00 

0.47 

1.22 

K0531 

0.67 

19 

11 

0.60 

1.12 

0.52 

0.98 

0.10 

0.00 

0.59 

0.85 

K0532 

-1.17 

17 

13 

0.76 

1.13 

0.43 

0.76 

0.03 

0.00 

0.61 

0.96 

K0533 

-0.29 

17 

12 

0.58 

0.92 

-0.26 

1.81 

1.61 

0.00 

0.33 

0.90 

K0534 

-1.50 

18 

16 

1.11 

0.51 

-0.45 

0.14 

-0.54 

0.00 

0.80 

1.29 

K0535 

-1.95 

18 

16 

1.08 

0.91 

0.15 

0.36 

-0.14 

0.00 

0.66 

1.12 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0536 

-1.97 

113 

105 

0.41 

1.24 

0.82 

1.24 

0.57 

0.00 

0.24 

0.90 

K0537 

-2.27 

121 

116 

0.50 

0.64 

-0.92 

0.22 

-1.30 

0.00 

0.48 

1.18 

K0538 

-1.89 

17 

16 

1.08 

0.89 

0.13 

0.34 

-0.17 

0.00 

0.36 

1.13 

K0539 

1.32 

18 

10 

0.61 

1.44 

1.45 

1.49 

1.05 

0.00 

0.44 

0.24 

K0540 

-2.08 

19 

18 

1.09 

1.27 

0.58 

1.56 

0.81 

0.00 

0.09 

0.78 

K0541 

0.00 

18 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

K0542 

-0.81 

18 

15 

0.75 

1.18 

0.51 

1.60 

0.86 

0.00 

0.36 

0.76 

K0543 

-1.18 

18 

15 

0.87 

1.18 

0.53 

0.64 

0.18 

0.00 

0.61 

0.90 

K0544 

-1.28 

17 

14 

0.91 

0.41 

-1.09 

0.18 

-0.46 

0.00 

0.80 

1.43 

K0545 

-2.21 

23 

22 

1.07 

1.20 

0.50 

1.35 

0.69 

0.00 

0.10 

0.85 

K0546 

-2.10 

16 

15 

1.08 

0.72 

-0.13 

0.30 

-0.23 

0.00 

0.37 

1.24 

K0547 

2.34 

19 

8 

0.61 

1.12 

0.55 

1.34 

0.71 

0.00 

0.57 

0.67 

K0548 

0.38 

20 

14 

0.56 

1.49 

1.82 

1.76 

1.24 

0.00 

0.17 

-0.02 

K0549 

-0.77 

18 

16 

0.83 

0.87 

-0.06 

0.95 

0.33 

0.00 

0.41 

1.03 

K0550 

-2.01 

18 

17 

1.09 

0.69 

-0.17 

0.19 

-0.43 

0.00 

0.46 

1.23 

KCCll 

-0.54 

98 

82 

0.29 

0.84 

-0.94 

0.75 

-0.62 

0.00 

0.44 

1.17 

KCCllO 

-1.06 

51 

46 

0.49 

0.69 

-0.86 

0.34 

-1.09 

0.00 

0.48 

1.26 

KCClll 

-0.91 

51 

42 

0.39 

1.00 

0.08 

0.91 

-0.09 

0.00 

0.26 

1.01 

KCC112 

-0.39 

102 

83 

0.28 

0.87 

-0.81 

0.63 

-1.26 

0.00 

0.49 

1.19 

KCC113 

-0.28 

55 

40 

0.34 

0.95 

-0.26 

1.26 

0.82 

0.00 

0.40 

1.01 

KCC114 

0.49 

51 

34 

0.34 

1.08 

0.61 

0.95 

-0.06 

0.00 

0.40 

0.87 

KCC115 

-0.63 

50 

40 

0.37 

1.10 

0.54 

1.35 

1.11 

0.00 

0.15 

0.85 

KCC116 

0.54 

49 

30 

0.32 

1.05 

0.48 

1.07 

0.46 

0.00 

0.34 

0.83 

KCC117 

-0.21 

51 

38 

0.36 

0.88 

-0.63 

0.69 

-1.07 

0.00 

0.50 

1.24 

KCC118 

-0.14 

51 

41 

0.38 

0.76 

-1.15 

0.58 

-1.08 

0.00 

0.57 

1.30 

KCC119 

-0.22 

52 

40 

0.36 

1.02 

0.16 

0.93 

-0.06 

0.00 

0.38 

0.99 

KCC12 

-1.02 

51 

46 

0.52 

1.19 

0.58 

1.05 

0.29 

0.00 

0.27 

0.90 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KCC120 

-0.51 

55 

48 

0.43 

0.85 

-0.45 

0.63 

-0.62 

0.00 

0.41 

1.14 

KCC121 

0.56 

49 

30 

0.33 

1.11 

0.82 

1.04 

0.28 

0.00 

0.36 

0.78 

KCC122 

0.05 

50 

38 

0.36 

0.93 

-0.34 

0.80 

-0.53 

0.00 

0.43 

1.14 

KCC13 

0.54 

53 

36 

0.32 

0.95 

-0.38 

0.93 

-0.27 

0.00 

0.40 

1.13 

KCC14 

-0.80 

48 

41 

0.44 

1.12 

0.51 

0.80 

-0.13 

0.00 

0.31 

0.94 

KCC15 

0.10 

51 

39 

0.36 

1.07 

0.42 

1.04 

0.23 

0.00 

0.28 

0.89 

KCC16 

-0.77 

50 

40 

0.37 

0.96 

-0.15 

0.81 

-0.40 

0.00 

0.32 

1.09 

KCC17 

-0.64 

54 

42 

0.36 

0.89 

-0.54 

0.71 

-0.63 

0.00 

0.47 

1.19 

KCC18 

-1.11 

51 

45 

0.47 

0.95 

-0.05 

0.64 

-0.30 

0.00 

0.34 

1.08 

KCC19 

-2.55 

50 

48 

0.73 

0.88 

0.01 

0.52 

-0.32 

0.00 

0.33 

1.08 

KCC21 

0.11 

49 

34 

0.34 

0.92 

-0.55 

0.83 

-0.69 

0.00 

0.46 

1.21 

KCC22 

-0.79 

50 

42 

0.41 

0.76 

-0.97 

0.80 

-0.35 

0.00 

0.46 

1.22 

KCC23 

-0.83 

51 

45 

0.46 

0.98 

0.05 

0.59 

-0.61 

0.00 

0.38 

1.08 

KCC24 

0.37 

52 

35 

0.33 

1.23 

1.51 

1.21 

0.82 

0.00 

0.25 

0.56 

KCC31 

-0.02 

51 

41 

0.39 

1.22 

0.99 

1.25 

0.73 

0.00 

0.25 

0.75 

KCC310 

0.58 

55 

40 

0.33 

1.09 

0.65 

1.22 

0.83 

0.00 

0.29 

0.80 

KCC311 

-1.29 

96 

86 

0.35 

0.80 

-0.81 

0.42 

-1.47 

0.00 

0.45 

1.20 

KCC312 

-0.39 

49 

38 

0.37 

1.15 

0.84 

1.14 

0.51 

0.00 

0.24 

0.79 

KCC313 

-1.78 

98 

91 

0.41 

0.89 

-0.25 

0.57 

-0.71 

0.00 

0.30 

1.09 

KCC314 

1.58 

50 

24 

0.32 

1.15 

1.23 

1.16 

0.91 

0.00 

0.36 

0.56 

KCC315 

-1.39 

52 

48 

0.53 

0.87 

-0.19 

0.50 

-0.67 

0.00 

0.37 

1.12 

KCC316 

-2.31 

48 

46 

0.74 

0.93 

0.08 

0.34 

-0.30 

0.00 

0.30 

1.09 

KCC317 

-0.84 

51 

45 

0.46 

1.02 

0.16 

1.26 

0.60 

0.00 

0.20 

0.95 

KCC318 

-0.91 

50 

41 

0.39 

0.99 

0.03 

1.01 

0.16 

0.00 

0.25 

0.99 

KCC319 

0.51 

52 

30 

0.31 

1.08 

0.68 

1.18 

0.80 

0.00 

0.36 

0.72 

KCC32 

-3.18 

51 

50 

1.03 

0.74 

0.00 

0.11 

-0.69 

0.00 

0.30 

1.15 

KCC320 

-0.37 

50 

38 

0.35 

0.93 

-0.36 

0.89 

-0.35 

0.00 

0.40 

1.11 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KCC321 

-0.38 

49 

38 

0.37 

1.09 

0.52 

1.10 

0.42 

0.00 

0.25 

0.87 

KCC322 

-1.99 

50 

47 

0.61 

0.96 

0.08 

0.51 

-0.45 

0.00 

0.28 

1.07 

KCC33 

-0.14 

51 

41 

0.38 

1.01 

0.12 

0.92 

-0.07 

0.00 

0.37 

1.01 

KCC34 

0.03 

52 

38 

0.34 

0.99 

-0.02 

0.95 

-0.04 

0.00 

0.41 

1.02 

KCC35 

-0.55 

51 

44 

0.45 

0.87 

-0.34 

1.09 

0.34 

0.00 

0.44 

1.06 

KCC36 

-0.93 

55 

50 

0.49 

1.01 

0.15 

4.64 

3.20 

0.00 

0.07 

0.83 

KCC37 

-1.22 

49 

43 

0.46 

1.18 

0.66 

1.62 

1.13 

0.00 

0.09 

0.79 

KCC38 

-0.50 

47 

39 

0.41 

0.98 

-0.02 

1.05 

0.26 

0.00 

0.31 

1.00 

KCC39 

-0.56 

52 

44 

0.40 

0.88 

-0.41 

0.79 

-0.39 

0.00 

0.38 

1.12 

KCC41 

0.41 

48 

33 

0.35 

1.14 

0.91 

1.49 

1.46 

0.00 

0.34 

0.67 

KCC42 

-1.66 

50 

47 

0.61 

0.93 

0.01 

0.89 

0.16 

0.00 

0.23 

1.04 

KCC43 

-1.43 

50 

44 

0.45 

0.91 

-0.18 

0.86 

-0.07 

0.00 

0.28 

1.07 

KCC44 

0.11 

51 

33 

0.32 

0.97 

-0.15 

0.88 

-0.35 

0.00 

0.44 

1.10 

KCC51 

-0.72 

50 

42 

0.42 

0.91 

-0.29 

0.71 

-0.33 

0.00 

0.39 

1.12 

KCC510 

-1.51 

50 

45 

0.49 

1.04 

0.23 

0.80 

-0.24 

0.00 

0.24 

1.00 

KCC511 

-2.02 

49 

46 

0.61 

0.91 

-0.03 

0.57 

-0.35 

0.00 

0.31 

1.07 

KCC512 

-0.21 

50 

38 

0.36 

1.02 

0.17 

1.18 

0.68 

0.00 

0.30 

0.92 

KCC513 

-0.83 

51 

45 

0.46 

0.91 

-0.18 

1.00 

0.20 

0.00 

0.35 

1.05 

KCC514 

-0.65 

52 

43 

0.40 

1.13 

0.62 

1.05 

0.26 

0.00 

0.27 

0.88 

KCC515 

-2.22 

49 

47 

0.79 

0.78 

-0.16 

0.75 

0.16 

0.00 

0.37 

1.07 

KCC516 

-2.21 

98 

93 

0.47 

1.04 

0.23 

1.65 

1.06 

0.00 

0.12 

0.96 

KCC517 

-0.66 

53 

47 

0.46 

1.10 

0.40 

1.16 

0.46 

0.00 

0.19 

0.91 

KCC518 

-0.53 

49 

39 

0.38 

1.09 

0.48 

1.20 

0.64 

0.00 

0.25 

0.85 

KCC519 

0.80 

47 

29 

0.33 

1.20 

1.51 

1.18 

0.85 

0.00 

0.26 

0.48 

KCC52 

1.47 

52 

25 

0.30 

1.06 

0.59 

1.03 

0.24 

0.00 

0.34 

0.82 

KCC520 

1.01 

48 

28 

0.34 

1.07 

0.51 

1.16 

0.71 

0.00 

0.45 

0.84 

KCC521 

-2.10 

50 

48 

0.74 

0.95 

0.13 

0.41 

-0.41 

0.00 

0.25 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KCC522 

-0.77 

50 

40 

0.37 

0.91 

-0.36 

0.97 

0.04 

0.00 

0.32 

1.08 

KCC53 

1.39 

50 

20 

0.32 

1.09 

0.76 

1.02 

0.18 

0.00 

0.37 

0.80 

KCC54 

-0.35 

49 

39 

0.39 

0.85 

-0.69 

0.70 

-0.50 

0.00 

0.45 

1.20 

KCC55 

-3.14 

48 

47 

1.02 

0.87 

0.17 

0.21 

-0.50 

0.00 

0.36 

1.10 

KCC56 

-2.47 

48 

46 

0.74 

1.07 

0.33 

1.03 

0.36 

0.00 

0.08 

0.95 

KCC57 

-0.34 

100 

81 

0.27 

1.05 

0.38 

1.44 

1.37 

0.00 

0.27 

0.89 

KCC58 

-0.79 

48 

40 

0.41 

0.90 

-0.34 

0.97 

0.07 

0.00 

0.35 

1.09 

KCC59 

-0.83 

51 

45 

0.46 

0.83 

-0.47 

0.64 

-0.49 

0.00 

0.45 

1.14 

KCC61 

1.50 

51 

23 

0.32 

1.21 

1.68 

1.29 

1.44 

0.00 

0.27 

0.39 

KCC62 

-1.02 

49 

44 

0.52 

0.82 

-0.37 

0.52 

-0.68 

0.00 

0.50 

1.14 

KCC63 

-0.63 

52 

46 

0.46 

0.96 

-0.04 

1.04 

0.27 

0.00 

0.29 

1.01 

KCC64 

-2.05 

49 

46 

0.61 

1.03 

0.22 

0.63 

-0.22 

0.00 

0.23 

1.02 

KCC71 

0.69 

47 

30 

0.33 

1.17 

1.24 

1.20 

0.88 

0.00 

0.27 

0.56 

KCC710 

-0.92 

52 

46 

0.45 

0.95 

-0.05 

0.64 

-0.62 

0.00 

0.33 

1.08 

KCC711 

-0.44 

48 

39 

0.41 

0.98 

-0.02 

0.69 

-0.51 

0.00 

0.43 

1.08 

KCC712 

0.00 

102 

82 

0.27 

0.93 

-0.43 

0.76 

-0.86 

0.00 

0.44 

1.11 

KCC713 

0.35 

50 

36 

0.34 

1.03 

0.23 

0.93 

-0.14 

0.00 

0.34 

0.98 

KCC714 

0.16 

50 

32 

0.32 

0.91 

-0.75 

0.84 

-0.73 

0.00 

0.42 

1.30 

KCC715 

0.19 

50 

32 

0.32 

0.81 

-1.53 

0.70 

-1.12 

0.00 

0.56 

1.50 

KCC716 

-0.51 

49 

40 

0.40 

0.85 

-0.63 

0.63 

-0.59 

0.00 

0.45 

1.21 

KCC717 

1.16 

48 

22 

0.31 

1.33 

3.06 

1.41 

3.04 

0.00 

-0.08 

-0.49 

KCC718 

0.00 

48 

34 

0.34 

0.90 

-0.65 

0.78 

-0.84 

0.00 

0.48 

1.24 

KCC719 

0.49 

48 

30 

0.33 

0.93 

-0.48 

0.90 

-0.56 

0.00 

0.42 

1.20 

KCC72 

0.83 

51 

33 

0.32 

0.96 

-0.22 

0.98 

-0.02 

0.00 

0.44 

1.07 

KCC720 

0.80 

51 

30 

0.32 

1.00 

0.06 

0.95 

-0.15 

0.00 

0.44 

1.01 

KCC721 

-0.02 

49 

39 

0.39 

0.88 

-0.47 

0.78 

-0.51 

0.00 

0.49 

1.14 

KCC722 

0.68 

52 

37 

0.34 

0.94 

-0.35 

0.86 

-0.46 

0.00 

0.44 

1.13 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KCC73 

-1.22 

49 

43 

0.46 

1.01 

0.14 

0.76 

-0.29 

0.00 

0.31 

1.03 

KCC74 

0.22 

47 

34 

0.35 

0.96 

-0.18 

0.85 

-0.41 

0.00 

0.41 

1.11 

KCC75 

-0.41 

52 

43 

0.38 

1.00 

0.08 

1.02 

0.17 

0.00 

0.26 

0.99 

KCC76 

0.17 

100 

64 

0.23 

0.92 

-0.86 

0.84 

-0.93 

0.00 

0.44 

1.24 

KCC77 

1.12 

48 

27 

0.34 

0.95 

-0.27 

0.95 

-0.17 

0.00 

0.53 

1.09 

KCC78 

0.98 

50 

30 

0.32 

0.98 

-0.18 

0.91 

-0.34 

0.00 

0.41 

1.10 

KCC79 

-0.77 

50 

40 

0.37 

0.91 

-0.41 

0.76 

-0.57 

0.00 

0.36 

1.15 

KGll 

-1.71 

50 

45 

0.50 

1.01 

0.14 

0.60 

-0.43 

0.00 

0.33 

1.06 

KG12 

-0.35 

49 

39 

0.39 

0.83 

-0.79 

0.66 

-0.59 

0.00 

0.46 

1.24 

KG13 

0.40 

48 

30 

0.32 

1.00 

0.00 

1.02 

0.15 

0.00 

0.32 

0.99 

KG14 

-0.38 

48 

37 

0.37 

1.14 

0.74 

1.05 

0.27 

0.00 

0.23 

0.84 

KG21 

-0.97 

48 

41 

0.43 

1.06 

0.30 

0.94 

0.01 

0.00 

0.25 

0.97 

KG22 

-1.06 

51 

46 

0.50 

1.06 

0.27 

0.99 

0.20 

0.00 

0.26 

0.98 

KG23 

-1.42 

51 

46 

0.50 

0.87 

-0.27 

0.71 

-0.19 

0.00 

0.39 

1.10 

KG24 

-0.55 

49 

42 

0.45 

0.86 

-0.39 

0.61 

-0.74 

0.00 

0.50 

1.15 

KG31 

0.32 

52 

40 

0.36 

1.01 

0.13 

0.97 

0.03 

0.00 

0.36 

1.00 

KG310 

-0.85 

49 

41 

0.41 

0.90 

-0.36 

0.88 

-0.13 

0.00 

0.40 

1.11 

KG311 

-1.11 

47 

42 

0.49 

0.95 

-0.02 

0.92 

0.10 

0.00 

0.29 

1.04 

KG312 

0.22 

52 

38 

0.33 

0.80 

-1.40 

0.65 

-1.40 

0.00 

0.55 

1.42 

KG313 

2.16 

48 

18 

0.35 

1.72 

3.72 

2.17 

3.56 

0.00 

-0.02 

-0.40 

KG314 

2.54 

50 

15 

0.35 

0.90 

-0.54 

0.93 

-0.18 

0.00 

0.52 

1.13 

KG315 

-1.43 

50 

44 

0.45 

0.93 

-0.12 

0.63 

-0.58 

0.00 

0.31 

1.10 

KG316 

-0.14 

50 

35 

0.34 

1.08 

0.57 

2.50 

3.36 

0.00 

0.24 

0.67 

KG317 

0.89 

49 

29 

0.33 

1.09 

0.79 

1.01 

0.14 

0.00 

0.41 

0.77 

KG318 

0.60 

48 

28 

0.31 

0.96 

-0.35 

0.93 

-0.49 

0.00 

0.38 

1.18 

KG319 

0.11 

48 

33 

0.34 

0.94 

-0.38 

0.90 

-0.36 

0.00 

0.43 

1.14 

KG32 

0.16 

48 

33 

0.34 

0.93 

-0.41 

0.84 

-0.73 

0.00 

0.42 

1.18 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KG320 

1.61 

51 

25 

0.31 

0.98 

-0.11 

0.95 

-0.21 

0.00 

0.44 

1.06 

KG321 

0.39 

51 

34 

0.33 

1.00 

0.06 

0.98 

0.01 

0.00 

0.42 

1.00 

KG322 

-1.02 

49 

44 

0.52 

0.85 

-0.29 

0.52 

-0.68 

0.00 

0.49 

1.13 

KG323 

-0.63 

52 

46 

0.46 

0.83 

-0.48 

0.52 

-0.80 

0.00 

0.44 

1.17 

KG324 

-0.13 

49 

36 

0.35 

0.82 

-1.11 

0.71 

-1.05 

0.00 

0.54 

1.33 

KG325 

-1.11 

47 

42 

0.49 

0.81 

-0.49 

0.44 

-0.86 

0.00 

0.43 

1.19 

KG326 

-0.73 

52 

45 

0.42 

0.91 

-0.24 

0.73 

-0.48 

0.00 

0.35 

1.10 

KG327 

-1.24 

48 

43 

0.50 

0.83 

-0.43 

0.43 

-0.66 

0.00 

0.45 

1.18 

KG328 

-1.38 

102 

93 

0.37 

0.93 

-0.20 

0.59 

-0.74 

0.00 

0.37 

1.08 

KG329 

-0.84 

50 

44 

0.46 

0.94 

-0.08 

0.80 

-0.14 

0.00 

0.30 

1.06 

KG33 

-0.51 

50 

38 

0.35 

0.90 

-0.55 

0.84 

-0.40 

0.00 

0.37 

1.16 

KG330 

0.29 

50 

31 

0.32 

1.04 

0.39 

0.95 

-0.13 

0.00 

0.38 

0.94 

KG331 

0.73 

97 

57 

0.23 

0.88 

-1.62 

0.80 

-1.31 

0.00 

0.49 

1.44 

KG332 

1.32 

49 

25 

0.33 

1.12 

1.01 

1.06 

0.33 

0.00 

0.43 

0.70 

KG333 

1.07 

48 

23 

0.31 

0.88 

-1.34 

0.83 

-1.44 

0.00 

0.50 

1.61 

KG334 

0.94 

48 

25 

0.31 

1.01 

0.09 

1.20 

1.27 

0.00 

0.36 

0.88 

KG335 

1.61 

48 

19 

0.32 

1.06 

0.52 

1.17 

0.97 

0.00 

0.34 

0.79 

KG336 

1.71 

51 

24 

0.31 

1.05 

0.51 

1.15 

0.89 

0.00 

0.36 

0.76 

KG337 

1.91 

51 

19 

0.33 

0.81 

-1.41 

0.75 

-1.13 

0.00 

0.59 

1.42 

KG338 

1.05 

96 

52 

0.23 

0.98 

-0.24 

0.97 

-0.16 

0.00 

0.45 

1.07 

KG339 

1.61 

48 

25 

0.32 

1.04 

0.39 

0.98 

-0.06 

0.00 

0.40 

0.92 

KG34 

-1.13 

52 

48 

0.54 

0.90 

-0.11 

0.64 

-0.27 

0.00 

0.32 

1.08 

KG340 

1.70 

49 

19 

0.33 

1.07 

0.56 

1.10 

0.57 

0.00 

0.39 

0.82 

KG341 

0.69 

47 

30 

0.33 

0.91 

-0.62 

0.86 

-0.54 

0.00 

0.47 

1.23 

KG342 

1.20 

52 

28 

0.30 

1.51 

4.34 

1.83 

4.53 

0.00 

-0.18 

-1.03 

KG35 

-1.24 

48 

43 

0.50 

0.83 

-0.43 

0.43 

-0.66 

0.00 

0.45 

1.18 

KG36 

-0.65 

50 

43 

0.43 

0.93 

-0.17 

0.74 

-0.34 

0.00 

0.33 

1.09 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KG37 

1.33 

50 

20 

0.32 

1.13 

1.09 

1.16 

0.94 

0.00 

0.31 

0.62 

KG38 

-0.14 

50 

35 

0.34 

1.00 

0.06 

1.05 

0.25 

0.00 

0.36 

0.96 

KG39 

0.25 

98 

71 

0.25 

0.98 

-0.13 

0.96 

-0.10 

0.00 

0.41 

1.02 

KG41 

-1.93 

49 

46 

0.63 

0.87 

-0.12 

1.98 

1.11 

0.00 

0.23 

1.00 

KG42 

-1.65 

48 

44 

0.53 

0.97 

0.06 

0.64 

-0.51 

0.00 

0.30 

1.06 

KG43 

-0.38 

48 

37 

0.37 

1.24 

1.23 

1.51 

1.48 

0.00 

0.06 

0.60 

KG44 

-0.79 

48 

40 

0.41 

1.27 

1.08 

1.46 

1.14 

0.00 

0.06 

0.69 

KG51 

0.50 

51 

36 

0.34 

1.09 

0.60 

1.06 

0.31 

0.00 

0.32 

0.85 

KG510 

-0.64 

51 

42 

0.40 

0.74 

-1.16 

0.48 

-1.17 

0.00 

0.58 

1.31 

KG511 

-1.42 

48 

45 

0.62 

0.98 

0.13 

0.47 

-0.52 

0.01 

0.31 

1.07 

KG512 

0.79 

52 

36 

0.33 

1.03 

0.28 

0.94 

-0.16 

0.00 

0.38 

0.97 

KG513 

0.23 

49 

33 

0.34 

0.86 

-0.98 

0.78 

-0.98 

0.00 

0.53 

1.32 

KG514 

0.22 

47 

34 

0.35 

0.97 

-0.12 

0.87 

-0.35 

0.00 

0.40 

1.08 

KG515 

1.38 

52 

26 

0.30 

1.17 

1.56 

1.14 

0.98 

0.00 

0.23 

0.44 

KG516 

-0.13 

48 

37 

0.38 

0.89 

-0.51 

0.98 

0.09 

0.00 

0.48 

1.12 

KG517 

-1.00 

100 

83 

0.28 

0.84 

-0.94 

0.69 

-0.90 

0.00 

0.42 

1.18 

KG518 

0.98 

50 

30 

0.32 

1.01 

0.14 

0.96 

-0.13 

0.00 

0.39 

0.99 

KG519 

-1.07 

50 

42 

0.40 

0.90 

-0.32 

0.86 

-0.17 

0.00 

0.32 

1.10 

KG52 

-0.26 

50 

36 

0.34 

0.93 

-0.40 

0.97 

0.02 

0.00 

0.42 

1.09 

KG520 

-0.20 

49 

38 

0.38 

1.30 

1.50 

1.48 

1.05 

0.00 

0.18 

0.51 

KG521 

-0.51 

48 

38 

0.37 

0.90 

-0.41 

0.74 

-0.86 

0.00 

0.43 

1.17 

KG522 

0.11 

48 

33 

0.34 

0.95 

-0.31 

0.95 

-0.13 

0.00 

0.41 

1.09 

KG523 

-0.48 

48 

38 

0.38 

1.09 

0.48 

1.03 

0.21 

0.00 

0.25 

0.90 

KG524 

0.00 

51 

40 

0.37 

0.85 

-0.72 

0.67 

-0.89 

0.00 

0.51 

1.22 

KG525 

0.04 

51 

37 

0.35 

0.95 

-0.26 

0.82 

-0.49 

0.00 

0.46 

1.12 

KG526 

1.20 

48 

29 

0.32 

0.95 

-0.34 

1.00 

0.08 

0.00 

0.43 

1.08 

KG527 

0.70 

102 

71 

0.24 

1.13 

1.18 

1.29 

1.49 

0.00 

0.29 

0.71 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KG528 

0.57 

52 

38 

0.34 

1.01 

0.09 

0.94 

-0.12 

0.00 

0.37 

1.00 

KG529 

-0.26 

49 

37 

0.36 

0.80 

-1.16 

0.64 

-1.22 

0.00 

0.55 

1.34 

KG53 

-0.34 

47 

38 

0.40 

1.05 

0.31 

0.97 

0.08 

0.00 

0.29 

0.95 

KG530 

0.54 

52 

35 

0.32 

0.88 

-1.00 

0.81 

-0.89 

0.00 

0.48 

1.33 

KG531 

0.78 

48 

30 

0.34 

1.36 

2.18 

1.32 

1.21 

0.00 

0.26 

0.34 

KG532 

0.46 

50 

35 

0.33 

1.15 

1.05 

1.51 

1.62 

0.00 

0.21 

0.60 

KG533 

-0.27 

50 

36 

0.34 

1.07 

0.49 

1.00 

0.09 

0.00 

0.27 

0.89 

KG534 

-0.14 

50 

35 

0.34 

0.87 

-0.83 

2.27 

2.97 

0.00 

0.41 

1.07 

KG535 

-2.39 

49 

47 

0.75 

0.71 

-0.32 

0.20 

-0.81 

0.00 

0.37 

1.18 

KG536 

-2.41 

48 

46 

0.73 

1.06 

0.31 

1.39 

0.69 

0.00 

0.01 

0.94 

KG537 

-0.82 

48 

40 

0.41 

1.04 

0.26 

0.96 

0.06 

0.00 

0.27 

0.97 

KG538 

0.00 

48 

48 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

KG539 

0.50 

51 

36 

0.34 

0.90 

-0.58 

0.79 

-0.73 

0.00 

0.49 

1.21 

KG54 

2.24 

51 

16 

0.34 

1.07 

0.48 

1.05 

0.26 

0.00 

0.39 

0.88 

KG540 

-3.91 

98 

97 

1.01 

0.98 

0.30 

0.35 

-0.33 

0.00 

0.15 

1.04 

KG541 

-2.61 

48 

47 

1.03 

0.83 

0.12 

0.16 

-0.50 

0.00 

0.33 

1.12 

KG542 

-1.91 

52 

50 

0.74 

1.15 

0.44 

2.12 

1.15 

0.00 

-0.03 

0.84 

KG55 

0.11 

49 

34 

0.34 

0.80 

-1.34 

0.68 

-1.38 

0.00 

0.57 

1.42 

KG56 

0.09 

47 

35 

0.36 

0.81 

-1.11 

0.66 

-1.04 

0.00 

0.51 

1.35 

KG57 

1.38 

52 

26 

0.30 

1.23 

2.08 

1.33 

2.14 

0.00 

0.14 

0.13 

KG58 

-0.06 

100 

77 

0.26 

0.91 

-0.67 

0.79 

-0.77 

0.00 

0.45 

1.15 

KG59 

-1.51 

48 

44 

0.55 

0.84 

-0.29 

1.35 

0.65 

0.00 

0.33 

1.06 

KG61 

0.65 

49 

33 

0.33 

0.99 

0.00 

1.28 

1.08 

0.00 

0.32 

0.91 

KG62 

1.76 

50 

16 

0.34 

1.00 

0.06 

1.03 

0.21 

0.00 

0.43 

0.99 

KG63 

-0.64 

50 

39 

0.37 

0.93 

-0.29 

1.10 

0.38 

0.00 

0.37 

1.04 

KG64 

2.67 

49 

14 

0.39 

0.80 

-0.92 

1.01 

0.16 

0.00 

0.64 

1.18 

KMDll 

-0.51 

48 

38 

0.37 

0.92 

-0.32 

1.08 

0.37 

0.00 

0.35 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KMDllO 

-1.00 

48 

41 

0.43 

0.83 

-0.55 

0.61 

-0.81 

0.00 

0.47 

1.18 

KMDlll 

-0.97 

48 

41 

0.43 

0.98 

0.00 

1.01 

0.17 

0.00 

0.29 

1.01 

KMD112 

0.14 

51 

39 

0.36 

1.22 

1.13 

1.39 

1.12 

0.00 

0.17 

0.65 

KMD113 

-0.64 

51 

42 

0.40 

1.06 

0.33 

0.77 

-0.35 

0.00 

0.36 

1.00 

KMD114 

-0.58 

48 

42 

0.46 

1.21 

0.75 

2.71 

2.42 

0.01 

-0.02 

0.68 

KMD115 

2.81 

52 

16 

0.34 

1.04 

0.27 

1.77 

2.49 

0.00 

0.36 

0.78 

KMD116 

1.18 

49 

24 

0.32 

1.12 

0.96 

1.07 

0.50 

0.00 

0.36 

0.71 

KMD12 

-0.88 

47 

41 

0.46 

0.73 

-0.90 

0.41 

-1.13 

0.00 

0.50 

1.27 

KMD13 

-0.74 

97 

80 

0.28 

0.89 

-0.61 

0.71 

-1.15 

0.00 

0.42 

1.15 

KMD14 

1.91 

99 

39 

0.23 

1.35 

3.55 

1.63 

4.21 

0.00 

0.08 

-0.03 

KMD15 

-0.92 

52 

46 

0.45 

1.04 

0.22 

1.32 

0.72 

0.00 

0.16 

0.94 

KMD16 

-0.13 

48 

37 

0.38 

1.21 

1.11 

1.35 

0.88 

0.00 

0.27 

0.69 

KMD17 

0.43 

49 

35 

0.34 

1.03 

0.28 

0.93 

-0.16 

0.00 

0.32 

0.97 

KMD18 

2.72 

50 

9 

0.42 

1.07 

0.33 

0.89 

-0.15 

0.00 

0.45 

0.98 

KMD19 

-1.48 

50 

44 

0.46 

0.78 

-0.64 

0.48 

-0.70 

0.00 

0.48 

1.20 

KMD21 

-1.31 

49 

44 

0.50 

0.92 

-0.12 

0.83 

0.07 

0.00 

0.31 

1.05 

KMD22 

-0.98 

48 

41 

0.42 

1.05 

0.27 

0.87 

-0.21 

0.00 

0.23 

0.99 

KMD23 

-2.02 

48 

45 

0.61 

0.92 

-0.01 

0.42 

-0.64 

0.00 

0.36 

1.10 

KMD24 

-0.48 

48 

38 

0.38 

1.13 

0.65 

1.41 

1.22 

0.00 

0.17 

0.77 

KMD25 

0.00 

51 

40 

0.37 

0.85 

-0.69 

0.64 

-0.98 

0.00 

0.52 

1.23 

KMD26 

1.80 

51 

20 

0.32 

1.19 

1.41 

1.20 

0.95 

0.00 

0.30 

0.56 

KMD27 

-0.58 

48 

42 

0.46 

1.10 

0.42 

3.65 

3.24 

0.01 

0.04 

0.74 

KMD28 

-0.86 

52 

47 

0.50 

0.83 

-0.39 

0.44 

-0.84 

0.00 

0.43 

1.16 

KMD31 

-1.45 

49 

44 

0.49 

0.95 

-0.03 

0.72 

-0.30 

0.00 

0.32 

1.06 

KMD310 

-0.05 

47 

36 

0.37 

1.00 

0.09 

1.16 

0.54 

0.00 

0.32 

0.95 

KMD311 

-0.22 

51 

41 

0.37 

0.91 

-0.40 

0.67 

-0.92 

0.00 

0.43 

1.17 

KMD312 

-0.61 

48 

40 

0.42 

0.95 

-0.11 

0.75 

-0.29 

0.00 

0.41 

1.06 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KMD313 

0.19 

49 

37 

0.35 

0.92 

-0.43 

0.81 

-0.47 

0.00 

0.38 

1.16 

KMD314 

-0.27 

50 

36 

0.34 

0.73 

-1.95 

0.61 

-1.55 

0.00 

0.53 

1.58 

KMD315 

-0.41 

101 

83 

0.28 

0.81 

-1.19 

0.72 

-0.87 

0.00 

0.48 

1.20 

KMD316 

-1.09 

50 

42 

0.41 

1.00 

0.07 

0.84 

-0.10 

0.00 

0.34 

1.03 

KMD317 

-0.20 

49 

38 

0.38 

0.89 

-0.52 

0.79 

-0.33 

0.00 

0.43 

1.16 

KMD318 

1.07 

48 

23 

0.31 

1.13 

1.31 

1.12 

1.03 

0.00 

0.19 

0.44 

KMD319 

0.11 

48 

33 

0.34 

0.89 

-0.76 

0.83 

-0.68 

0.00 

0.48 

1.26 

KMD32 

-3.18 

48 

47 

1.02 

1.06 

0.38 

1.53 

0.79 

0.00 

0.01 

0.93 

KMD320 

-2.12 

51 

49 

0.74 

1.08 

0.33 

0.73 

0.07 

0.00 

0.16 

0.98 

KMD321 

-1.42 

51 

46 

0.50 

0.80 

-0.48 

0.45 

-0.71 

0.00 

0.46 

1.17 

KMD322 

-0.81 

48 

43 

0.50 

1.11 

0.43 

0.82 

-0.12 

0.01 

0.23 

0.96 

KMD323 

-1.13 

52 

48 

0.54 

0.83 

-0.30 

0.84 

0.04 

0.00 

0.34 

1.09 

KMD324 

-1.65 

99 

90 

0.37 

0.96 

-0.07 

0.70 

-0.37 

0.00 

0.32 

1.07 

KMD325 

-0.26 

49 

37 

0.36 

1.01 

0.12 

1.11 

0.43 

0.00 

0.34 

0.93 

KMD326 

0.00 

47 

47 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

KMD327 

-0.87 

51 

45 

0.45 

0.95 

-0.05 

0.65 

-0.58 

0.00 

0.33 

1.08 

KMD328 

0.15 

48 

35 

0.37 

0.94 

-0.32 

0.86 

-0.28 

0.00 

0.49 

1.10 

KMD329 

-0.55 

49 

42 

0.43 

0.92 

-0.21 

0.79 

-0.24 

0.00 

0.31 

1.08 

KMD33 

1.76 

50 

16 

0.34 

1.29 

1.76 

1.66 

2.56 

0.00 

0.17 

0.34 

KMD330 

-1.48 

50 

44 

0.46 

0.83 

-0.47 

0.93 

0.13 

0.00 

0.39 

1.11 

KMD331 

-0.86 

49 

42 

0.44 

0.86 

-0.42 

0.60 

-0.48 

0.00 

0.41 

1.16 

KMD332 

1.86 

48 

15 

0.33 

1.21 

1.42 

1.23 

1.16 

0.00 

0.07 

0.53 

KMD333 

1.31 

100 

51 

0.22 

1.03 

0.40 

0.98 

-0.13 

0.00 

0.41 

0.95 

KMD334 

0.44 

48 

30 

0.32 

0.88 

-0.93 

0.80 

-1.03 

0.00 

0.51 

1.36 

KMD335 

-0.97 

48 

41 

0.43 

1.06 

0.30 

1.11 

0.39 

0.00 

0.22 

0.93 

KMD336 

-0.29 

51 

42 

0.40 

0.78 

-0.91 

0.53 

-1.13 

0.00 

0.55 

1.26 

KMD337 

-0.80 

51 

43 

0.42 

0.95 

-0.12 

2.18 

1.85 

0.00 

0.28 

0.91 



easyCBM CCSS Kindergarten Math Measure Development 


187 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KMD338 

-0.58 

48 

42 

0.46 

0.94 

-0.08 

0.71 

-0.45 

0.01 

0.36 

1.07 

KMD339 

-1.91 

52 

50 

0.74 

0.90 

0.04 

0.30 

-0.56 

0.00 

0.32 

1.10 

KMD34 

-1.72 

49 

45 

0.54 

0.92 

-0.08 

0.90 

0.09 

0.00 

0.29 

1.05 

KMD340 

-0.68 

47 

40 

0.43 

0.90 

-0.29 

0.67 

-0.54 

0.00 

0.38 

1.13 

KMD341 

0.49 

51 

35 

0.32 

0.94 

-0.46 

0.83 

-0.70 

0.00 

0.43 

1.19 

KMD342 

-0.28 

48 

38 

0.39 

0.92 

-0.36 

1.09 

0.34 

0.00 

0.44 

1.06 

KMD351 

-0.60 

100 

84 

0.30 

1.02 

0.16 

0.84 

-0.38 

0.00 

0.38 

1.01 

KMD367 

1.42 

148 

69 

0.19 

0.90 

-1.33 

0.88 

-1.11 

0.00 

0.53 

1.25 

KNBTll 

1.77 

49 

22 

0.32 

1.14 

1.20 

1.32 

1.74 

0.00 

0.29 

0.43 

KNBTllO 

1.13 

50 

22 

0.31 

1.13 

1.12 

1.19 

1.16 

0.00 

0.30 

0.55 

KNBTllOO 

1.19 

50 

22 

0.32 

0.98 

-0.15 

1.21 

1.03 

0.00 

0.42 

0.98 

KNBTlll 

2.26 

49 

17 

0.36 

1.20 

1.09 

1.04 

0.23 

0.00 

0.46 

0.76 

KNBT112 

0.97 

48 

24 

0.31 

1.02 

0.25 

1.02 

0.20 

0.00 

0.31 

0.91 

KNBT113 

1.34 

48 

21 

0.32 

1.05 

0.44 

1.11 

0.70 

0.00 

0.33 

0.81 

KNBT114 

2.70 

48 

10 

0.39 

1.14 

0.68 

1.17 

0.55 

0.00 

0.29 

0.82 

KNBT115 

1.30 

99 

46 

0.23 

1.13 

1.52 

1.19 

1.17 

0.00 

0.37 

0.61 

KNBT116 

0.93 

51 

32 

0.32 

0.99 

0.00 

0.91 

-0.35 

0.00 

0.43 

1.05 

KNBT117 

0.70 

51 

31 

0.32 

1.09 

0.70 

1.00 

0.07 

0.00 

0.38 

0.83 

KNBT118 

2.34 

48 

18 

0.33 

1.14 

1.04 

1.52 

2.28 

0.00 

0.26 

0.50 

KNBT119 

1.50 

52 

29 

0.31 

0.98 

-0.12 

1.15 

0.85 

0.00 

0.42 

0.97 

KNBT12 

-0.13 

49 

36 

0.35 

1.13 

0.82 

1.07 

0.35 

0.00 

0.29 

0.81 

KNBT120 

-0.42 

100 

79 

0.26 

1.03 

0.29 

1.03 

0.19 

0.00 

0.29 

0.96 

KNBT121 

-0.19 

47 

37 

0.38 

1.08 

0.44 

0.96 

0.04 

0.00 

0.29 

0.93 

KNBT122 

0.16 

51 

38 

0.34 

0.81 

-1.21 

0.66 

-1.26 

0.00 

0.53 

1.36 

KNBT123 

0.02 

48 

36 

0.37 

0.90 

-0.51 

0.97 

0.06 

0.00 

0.48 

1.12 

KNBT124 

2.66 

49 

14 

0.36 

1.21 

1.11 

1.18 

0.75 

0.00 

0.32 

0.71 

KNBT125 

3.36 

50 

6 

0.51 

1.19 

0.62 

2.95 

2.45 

0.00 

0.22 

0.73 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KNBT126 

1.49 

50 

19 

0.32 

1.12 

0.98 

1.23 

1.01 

0.00 

0.31 

0.63 

KNBT127 

1.21 

49 

26 

0.33 

1.03 

0.31 

1.23 

0.98 

0.00 

0.45 

0.82 

KNBT128 

1.55 

48 

18 

0.32 

0.94 

-0.45 

0.95 

-0.30 

0.00 

0.40 

1.16 

KNBT129 

1.24 

48 

22 

0.32 

1.06 

0.55 

1.01 

0.14 

0.00 

0.35 

0.84 

KNBT13 

3.04 

48 

8 

0.43 

0.82 

-0.59 

0.67 

-0.69 

0.00 

0.55 

1.18 

KNBT130 

1.90 

51 

22 

0.31 

1.29 

2.28 

1.45 

2.22 

0.00 

0.15 

0.10 

KNBT131 

2.13 

51 

17 

0.33 

1.01 

0.14 

0.98 

-0.01 

0.00 

0.43 

0.98 

KNBT132 

1.41 

48 

27 

0.32 

1.08 

0.69 

1.17 

1.01 

0.00 

0.33 

0.70 

KNBT133 

2.27 

52 

21 

0.32 

1.00 

0.03 

1.00 

0.04 

0.00 

0.45 

1.00 

KNBT134 

1.81 

48 

17 

0.33 

1.04 

0.35 

1.03 

0.20 

0.00 

0.37 

0.91 

KNBT135 

0.58 

47 

31 

0.34 

0.90 

-0.68 

0.84 

-0.58 

0.00 

0.47 

1.24 

KNBT136 

0.16 

51 

38 

0.34 

0.93 

-0.37 

0.82 

-0.58 

0.00 

0.40 

1.14 

KNBT137 

0.02 

48 

36 

0.37 

0.93 

-0.31 

0.69 

-0.74 

0.00 

0.50 

1.16 

KNBT138 

0.31 

49 

36 

0.35 

1.01 

0.10 

0.98 

0.05 

0.00 

0.32 

0.98 

KNBT139 

0.65 

50 

27 

0.31 

0.88 

-1.19 

0.86 

-0.83 

0.00 

0.47 

1.45 

KNBT14 

0.59 

50 

28 

0.31 

0.92 

-0.66 

0.88 

-0.47 

0.00 

0.47 

1.24 

KNBT140 

0.67 

49 

31 

0.34 

0.91 

-0.71 

0.81 

-0.61 

0.00 

0.50 

1.26 

KNBT141 

0.30 

48 

31 

0.32 

0.99 

-0.01 

0.91 

-0.52 

0.00 

0.35 

1.08 

KNBT142 

-0.31 

97 

74 

0.25 

0.98 

-0.09 

0.98 

-0.06 

0.00 

0.33 

1.03 

KNBT143 

0.78 

101 

64 

0.23 

0.90 

-1.00 

0.96 

-0.21 

0.00 

0.49 

1.19 

KNBT144 

-0.63 

100 

84 

0.29 

1.01 

0.12 

0.96 

-0.01 

0.00 

0.31 

0.98 

KNBT145 

-0.38 

48 

37 

0.37 

1.13 

0.73 

1.19 

0.66 

0.00 

0.20 

0.80 

KNBT146 

0.38 

48 

31 

0.33 

0.94 

-0.42 

0.90 

-0.48 

0.00 

0.41 

1.17 

KNBT147 

0.08 

50 

39 

0.37 

1.03 

0.22 

1.04 

0.24 

0.00 

0.33 

0.96 

KNBT148 

-0.23 

99 

79 

0.27 

1.14 

0.97 

1.12 

0.54 

0.00 

0.20 

0.84 

KNBT149 

-0.34 

51 

40 

0.37 

1.17 

0.87 

2.69 

3.01 

0.00 

0.18 

0.67 

KNBT15 

0.76 

48 

33 

0.34 

1.00 

0.05 

0.92 

-0.30 

0.00 

0.40 

1.03 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KNBT150 

-0.63 

52 

46 

0.46 

1.05 

0.27 

0.78 

-0.21 

0.00 

0.29 

1.01 

KNBT151 

1.49 

48 

20 

0.32 

1.43 

3.06 

1.56 

2.76 

0.00 

0.02 

-0.20 

KNBT152 

0.91 

47 

28 

0.33 

1.02 

0.18 

0.97 

-0.08 

0.00 

0.40 

0.97 

KNBT153 

1.44 

51 

25 

0.30 

0.93 

-0.61 

0.91 

-0.59 

0.00 

0.46 

1.24 

KNBT154 

0.66 

48 

31 

0.35 

0.88 

-0.73 

0.86 

-0.43 

0.00 

0.56 

1.21 

KNBT155 

2.79 

49 

13 

0.37 

1.02 

0.16 

1.36 

1.22 

0.00 

0.42 

0.91 

KNBT156 

0.43 

49 

29 

0.31 

1.17 

1.60 

1.12 

0.70 

0.00 

0.23 

0.40 

KNBT157 

1.93 

50 

15 

0.34 

0.97 

-0.15 

1.13 

0.54 

0.00 

0.42 

0.99 

KNBT158 

1.21 

49 

26 

0.33 

0.92 

-0.62 

0.88 

-0.44 

0.00 

0.53 

1.21 

KNBT159 

1.26 

48 

21 

0.31 

1.19 

1.82 

1.20 

1.51 

0.00 

0.10 

0.22 

KNBT16 

0.54 

48 

29 

0.32 

1.06 

0.54 

1.09 

0.54 

0.00 

0.32 

0.80 

KNBT160 

2.42 

48 

12 

0.37 

1.10 

0.59 

1.20 

0.71 

0.00 

0.31 

0.83 

KNBT161 

2.74 

50 

14 

0.34 

1.24 

1.43 

2.06 

3.02 

0.00 

0.09 

0.41 

KNBT162 

2.13 

51 

17 

0.33 

1.10 

0.67 

1.90 

2.93 

0.00 

0.29 

0.62 

KNBT163 

2.56 

48 

16 

0.34 

0.91 

-0.62 

1.24 

1.02 

0.00 

0.47 

1.12 

KNBT164 

1.40 

52 

30 

0.31 

0.91 

-0.82 

0.83 

-0.89 

0.00 

0.50 

1.31 

KNBT165 

1.38 

48 

21 

0.32 

1.07 

0.59 

1.02 

0.17 

0.00 

0.37 

0.85 

KNBT166 

1.65 

47 

21 

0.33 

1.05 

0.42 

0.99 

0.03 

0.00 

0.42 

0.91 

KNBT167 

1.07 

51 

29 

0.31 

1.00 

0.00 

0.93 

-0.42 

0.00 

0.40 

1.07 

KNBT168 

0.89 

48 

29 

0.34 

1.05 

0.39 

0.98 

0.00 

0.00 

0.47 

0.93 

KNBT171 

1.76 

100 

44 

0.23 

1.30 

3.22 

1.44 

2.56 

0.00 

0.21 

0.13 

KNBT197 

2.60 

48 

14 

0.36 

0.82 

-0.97 

0.74 

-1.01 

0.00 

0.60 

1.28 

KNBT198 

0.67 

48 

26 

0.32 

0.98 

-0.19 

0.95 

-0.24 

0.00 

0.39 

1.10 

KNBT199 

1.60 

50 

18 

0.33 

1.20 

1.42 

1.42 

1.66 

0.00 

0.24 

0.47 

KOAll 

0.44 

49 

33 

0.34 

1.27 

1.85 

2.07 

2.61 

0.00 

0.22 

0.19 

KOAllO 

0.09 

48 

33 

0.33 

0.90 

-0.69 

0.90 

-0.47 

0.00 

0.42 

1.23 

KOAlll 

1.97 

48 

15 

0.34 

0.99 

-0.02 

1.28 

1.21 

0.00 

0.35 

0.94 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

KOA112 

2.70 

48 

10 

0.39 

1.06 

0.33 

1.15 

0.51 

0.00 

0.36 

0.92 

KOA113 

1.11 

50 

30 

0.32 

1.10 

0.85 

1.24 

1.18 

0.00 

0.30 

0.66 

KOA114 

0.21 

50 

35 

0.34 

1.07 

0.48 

0.95 

-0.07 

0.00 

0.38 

0.92 

KOA115 

1.31 

48 

28 

0.32 

1.12 

1.01 

1.09 

0.59 

0.00 

0.32 

0.66 

KOA116 

1.88 

52 

25 

0.31 

1.11 

1.00 

1.11 

0.69 

0.00 

0.36 

0.66 

KOA117 

0.23 

48 

32 

0.34 

0.99 

-0.03 

0.92 

-0.28 

0.00 

0.43 

1.05 

KOA118 

1.12 

47 

26 

0.33 

1.22 

1.80 

1.23 

1.22 

0.00 

0.25 

0.32 

KOA119 

0.44 

50 

35 

0.33 

0.83 

-1.23 

0.71 

-1.29 

0.00 

0.53 

1.41 

KOA12 

0.51 

100 

68 

0.24 

0.99 

-0.06 

0.89 

-0.57 

0.00 

0.45 

1.06 

KOA120 

-0.44 

48 

39 

0.41 

1.00 

0.06 

0.85 

-0.13 

0.00 

0.40 

1.02 

KOA13 

2.47 

48 

15 

0.35 

1.07 

0.44 

1.55 

2.03 

0.00 

0.35 

0.74 

KOA14 

1.38 

48 

19 

0.33 

1.11 

0.86 

1.11 

0.64 

0.00 

0.33 

0.72 

KOA15 

2.59 

50 

10 

0.39 

1.10 

0.48 

1.48 

1.17 

0.00 

0.28 

0.81 

KOA16 

-1.31 

49 

44 

0.50 

0.95 

-0.03 

0.73 

-0.06 

0.00 

0.31 

1.05 

KOA17 

-0.98 

48 

41 

0.42 

0.86 

-0.44 

0.59 

-1.06 

0.00 

0.47 

1.18 

KOA18 

1.34 

48 

21 

0.32 

1.26 

2.13 

1.49 

2.70 

0.00 

0.10 

0.04 

KOA19 

-0.08 

48 

35 

0.35 

0.83 

-1.02 

0.73 

-1.08 

0.00 

0.48 

1.31 

KOA21 

1.31 

50 

28 

0.31 

0.87 

-1.14 

0.80 

-1.14 

0.00 

0.53 

1.43 

KOA210 

-0.44 

50 

40 

0.39 

0.72 

-1.35 

0.54 

-1.11 

0.00 

0.59 

1.34 

KOA211 

3.22 

100 

18 

0.29 

1.00 

0.03 

1.78 

2.18 

0.00 

0.33 

0.90 

KOA212 

-1.08 

48 

44 

0.55 

0.92 

-0.07 

0.54 

-0.56 

0.01 

0.36 

1.10 

KOA213 

2.08 

52 

23 

0.31 

0.86 

-1.22 

0.78 

-1.25 

0.00 

0.56 

1.43 

KOA214 

2.15 

48 

14 

0.35 

0.85 

-1.00 

0.75 

-0.97 

0.00 

0.54 

1.31 

KOA215 

-0.68 

47 

40 

0.43 

0.89 

-0.35 

0.77 

-0.31 

0.00 

0.38 

1.12 

KOA216 

3.19 

49 

9 

0.40 

1.08 

0.42 

1.25 

0.76 

0.00 

0.24 

0.87 

KOA217 

-0.13 

48 

37 

0.38 

1.01 

0.12 

1.07 

0.30 

0.00 

0.41 

0.98 

KOA32 

0.62 

97 

57 

0.22 

0.85 

-2.06 

0.80 

-1.93 

0.00 

0.53 

1.56 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

K0A41 

0.96 

100 

54 

0.22 

1.12 

1.56 

1.08 

0.61 

0.00 

0.33 

0.62 

KOA412 

1.80 

101 

44 

0.23 

1.06 

0.67 

1.07 

0.57 

0.00 

0.41 

0.83 

KOA514 

2.64 

99 

26 

0.25 

0.93 

-0.47 

1.20 

1.01 

0.00 

0.43 

1.02 

KOA517 

-0.04 

99 

71 

0.25 

0.99 

-0.02 

0.89 

-0.34 

0.00 

0.40 

1.03 
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Appendix E: Distractor Statistics 


Appendix E: Distractor Statistics for Full CCSS Item Bank 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30001 

* 

-1 

1307 

99 

1.38 

0.04 

0.00 

-0.03 

30001 

A 

1 

7 

58 

2.75 

0.50 

0.52 

0.74 

30001 

B 

0 

3 

25 

0.31 

0.52 

0.41 

-0.54 

30001 

C 

0 

1 

8 

-0.12 

0.00 

0.22 

-0.37 

30001 

D 

0 

1 

8 

1.28 

0.00 

0.87 

-0.10 

30011 

* 

-1 

1308 

99 

1.39 

0.04 

0.00 

0.04 

30011 

A 

1 

5 

45 

0.98 

0.45 

1.11 

0.20 

30011 

B 

0 

4 

36 

0.63 

0.34 

0.99 

-0.16 

30011 

C 

0 

1 

9 

1.57 

0.00 

2.17 

0.30 

30011 

D 

0 

1 

9 

-0.21 

0.00 

0.36 

-0.39 

30101 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

30101 

A 

1 

9 

53 

1.98 

0.61 

1.92 

0.41 

30101 

B 

0 

1 

6 

2.58 

0.00 

4.11 

0.18 

30101 

C 

0 

3 

18 

1.03 

0.39 

1.01 

-0.08 

30101 

D 

0 

4 

24 

-0.30 

0.74 

0.43 

-0.52 

30102 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

30102 

A 

1 

10 

56 

2.69 

0.40 

0.76 

0.68 

30102 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30102 

C 

0 

5 

28 

0.85 

0.44 

0.82 

-0.15 

30102 

D 

0 

3 

17 

-2.17 

1.31 

0.14 

-0.73 

30103 

* 

-1 

1195 

91 

1.39 

0.04 

0.00 

0.01 

30103 

A 

1 

69 

56 

1.87 

0.16 

1.02 

0.48 

30103 

B 

0 

22 

18 

0.64 

0.14 

0.76 

-0.24 

30103 

C 

0 

29 

23 

0.69 

0.13 

0.78 

-0.26 

30103 

D 

0 

4 

3 

-0.13 

0.94 

0.79 

-0.20 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30104 

* 

-1 

1309 

99 

1.38 

0.04 

0.00 

-0.04 

30104 

A 

1 

7 

70 

2.76 

0.65 

0.73 

0.61 

30104 

B 

0 

1 

10 

0.36 

0.00 

0.46 

-0.30 

30104 

C 

0 

2 

20 

0.23 

1.32 

0.81 

-0.48 

30104 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30105 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

30105 

A 

1 

17 

89 

1.75 

0.38 

1.04 

0.23 

30105 

B 

0 

2 

11 

0.60 

0.81 

1.11 

-0.23 

30105 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30105 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30106 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

30106 

A 

1 

14 

78 

1.90 

0.53 

1.11 

0.38 

30106 

B 

0 

3 

17 

-0.04 

0.62 

0.84 

-0.37 

30106 

C 

0 

1 

6 

0.80 

0.00 

1.36 

-0.09 

30106 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30109 

* 

-1 

1297 

98 

1.38 

0.04 

0.00 

0.00 

30109 

A 

1 

15 

68 

2.04 

0.52 

0.99 

0.52 

30109 

B 

0 

3 

14 

-0.53 

0.92 

0.82 

-0.37 

30109 

C 

0 

4 

18 

0.07 

0.43 

0.85 

-0.30 

30109 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30111 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.04 

30111 

A 

1 

11 

69 

1.48 

0.40 

0.71 

0.68 

30111 

B 

0 

2 

13 

-0.33 

0.14 

0.49 

-0.27 

30111 

C 

0 

1 

6 

-1.93 

0.00 

0.10 

-0.45 

30111 

D 

0 

2 

13 

-0.64 

0.73 

0.46 

-0.35 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30112 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

30112 

A 

1 

10 

63 

2.48 

0.64 

0.78 

0.60 

30112 

B 

0 

1 

6 

1.28 

0.00 

1.88 

-0.04 

30112 

C 

0 

4 

25 

-0.19 

0.44 

0.58 

-0.50 

30112 

D 

0 

1 

6 

-0.47 

0.00 

0.33 

-0.26 

30113 

* 

-1 

1305 

99 

1.39 

0.04 

0.00 

0.03 

30113 

A 

1 

10 

71 

1.34 

0.50 

0.87 

0.38 

30113 

B 

0 

1 

7 

0.16 

0.00 

0.71 

-0.13 

30113 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30113 

D 

0 

3 

21 

-0.14 

1.37 

1.40 

-0.33 

30114 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

30114 

A 

1 

12 

67 

2.14 

0.40 

1.14 

0.47 

30114 

B 

0 

3 

17 

1.52 

0.89 

2.13 

-0.04 

30114 

C 

0 

2 

11 

0.23 

0.21 

0.36 

-0.33 

30114 

D 

0 

1 

6 

-1.14 

0.00 

0.09 

-0.45 

30115 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

30115 

A 

1 

15 

83 

1.62 

0.50 

3.85 

0.08 

30115 

B 

0 

2 

11 

0.06 

0.61 

0.65 

-0.28 

30115 

C 

0 

1 

6 

3.54 

0.00 

17.76 

0.26 

30115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30116 

* 

-1 

1307 

99 

1.39 

0.04 

0.00 

0.03 

30116 

A 

1 

7 

58 

1.57 

0.50 

0.77 

0.63 

30116 

B 

0 

1 

8 

0.06 

0.00 

0.63 

-0.17 

30116 

C 

0 

2 

17 

0.10 

0.63 

0.78 

-0.25 

30116 

D 

0 

2 

17 

-0.57 

0.81 

0.45 

-0.46 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30117 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.05 

30117 

A 

1 

9 

64 

3.11 

0.55 

0.83 

0.70 

30117 

B 

0 

2 

14 

0.82 

0.02 

0.62 

-0.26 

30117 

C 

0 

2 

14 

0.32 

1.44 

0.84 

-0.36 

30117 

D 

0 

1 

7 

-1.13 

0.00 

0.09 

-0.45 

30118 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.02 

30118 

A 

1 

9 

64 

1.91 

0.48 

1.07 

0.26 

30118 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30118 

C 

0 

2 

14 

2.20 

1.18 

4.69 

0.16 

30118 

D 

0 

3 

21 

0.39 

0.86 

0.87 

-0.44 

30123 

* 

-1 

1206 

91 

1.38 

0.04 

0.00 

0.00 

30123 

A 

1 

75 

66 

1.76 

0.13 

0.90 

0.45 

30123 

B 

0 

5 

4 

-0.15 

0.24 

0.31 

-0.27 

30123 

C 

0 

30 

27 

0.75 

0.20 

1.46 

-0.31 

30123 

D 

0 

3 

3 

0.66 

0.07 

0.63 

-0.10 

30124 

* 

-1 

1305 

99 

1.39 

0.04 

0.00 

0.02 

30124 

A 

1 

8 

57 

2.05 

0.27 

0.52 

0.70 

30124 

B 

0 

3 

21 

0.27 

0.46 

0.50 

-0.30 

30124 

C 

0 

1 

7 

-2.94 

0.00 

0.02 

-0.75 

30124 

D 

0 

2 

14 

0.85 

0.46 

0.79 

-0.08 

30125 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.02 

30125 

A 

1 

17 

85 

2.30 

0.39 

0.74 

0.69 

30125 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30125 

C 

0 

1 

5 

-0.46 

0.00 

0.27 

-0.21 

30125 

D 

0 

2 

10 

-3.00 

2.12 

0.18 

-0.67 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30126 

* 

-1 

1304 

99 

1.38 

0.04 

0.00 

0.00 

30126 

A 

1 

8 

53 

1.83 

0.67 

1.56 

0.29 

30126 

B 

0 

1 

7 

0.14 

0.00 

0.37 

-0.25 

30126 

C 

0 

5 

33 

1.09 

0.27 

1.10 

-0.18 

30126 

D 

0 

1 

7 

1.45 

0.00 

1.37 

0.00 

30127 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

30127 

A 

1 

18 

95 

1.83 

0.40 

0.94 

0.32 

30127 

B 

0 

1 

5 

-0.64 

0.00 

0.31 

-0.32 

30127 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30128 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.09 

30128 

A 

1 

16 

84 

2.85 

0.34 

0.68 

0.59 

30128 

B 

0 

2 

11 

0.99 

0.01 

0.55 

-0.32 

30128 

C 

0 

1 

5 

-1.14 

0.00 

0.07 

-0.54 

30128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30129 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

0.01 

30129 

A 

1 

10 

63 

2.12 

0.40 

0.69 

0.54 

30129 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30129 

C 

0 

2 

13 

1.00 

1.90 

3.27 

-0.06 

30129 

D 

0 

4 

25 

-0.59 

1.24 

1.45 

-0.56 

30130 

* 

-1 

1309 

99 

1.39 

0.04 

0.00 

0.03 

30130 

A 

1 

2 

20 

1.75 

1.78 

2.31 

0.28 

30130 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30130 

C 

0 

6 

60 

1.15 

0.45 

1.14 

0.18 

30130 

D 

0 

2 

20 

-0.48 

1.15 

0.24 

-0.50 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30134 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.04 

30134 

A 

1 

16 

76 

1.47 

0.35 

0.67 

0.54 

30134 

B 

0 

2 

10 

0.26 

0.24 

0.89 

-0.11 

30134 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30134 

D 

0 

3 

14 

-1.69 

1.70 

1.09 

-0.57 

30135 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

30135 

A 

1 

15 

88 

2.21 

0.44 

0.89 

0.71 

30135 

B 

0 

1 

6 

-0.89 

0.00 

0.20 

-0.25 

30135 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30135 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.71 

30251 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

30251 

A 

1 

15 

83 

1.98 

0.45 

0.66 

0.55 

30251 

B 

0 

1 

6 

0.07 

0.00 

0.72 

-0.19 

30251 

C 

0 

1 

6 

-0.12 

0.00 

0.60 

-0.21 

30251 

D 

0 

1 

6 

-2.37 

0.00 

0.06 

-0.50 

30252 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

30252 

A 

1 

14 

82 

2.12 

0.42 

0.79 

0.54 

30252 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30252 

C 

0 

2 

12 

0.16 

0.09 

0.47 

-0.35 

30252 

D 

0 

1 

6 

-0.96 

0.00 

0.15 

-0.41 

30254 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

30254 

A 

1 

16 

94 

1.46 

0.34 

1.00 

0.25 

30254 

B 

0 

1 

6 

0.05 

0.00 

0.49 

-0.25 

30254 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30254 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30255 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.03 

30255 

A 

1 

14 

88 

2.04 

0.35 

0.80 

0.39 

30255 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30255 

C 

0 

1 

6 

1.95 

0.00 

2.36 

0.02 

30255 

D 

0 

1 

6 

-1.14 

0.00 

0.11 

-0.55 

30256 

* 

-1 

1305 

99 

1.39 

0.04 

0.00 

0.05 

30256 

A 

1 

11 

79 

0.97 

0.28 

0.77 

0.48 

30256 

B 

0 

1 

7 

0.82 

0.00 

1.57 

0.04 

30256 

C 

0 

1 

7 

0.57 

0.00 

1.22 

-0.01 

30256 

D 

0 

1 

7 

-3.08 

0.00 

0.03 

-0.80 

30257 

* 

-1 

1294 

98 

1.37 

0.04 

0.00 

-0.04 

30257 

A 

1 

17 

68 

2.36 

0.43 

1.54 

0.38 

30257 

B 

0 

7 

28 

1.31 

0.52 

2.12 

-0.19 

30257 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30257 

D 

0 

1 

4 

-2.49 

0.00 

0.02 

-0.48 

30259 

* 

-1 

1209 

92 

1.38 

0.04 

0.00 

-0.02 

30259 

A 

1 

102 

93 

1.63 

0.11 

0.80 

0.48 

30259 

B 

0 

2 

2 

-1.19 

0.09 

0.13 

-0.30 

30259 

C 

0 

6 

5 

-0.39 

0.48 

0.42 

-0.37 

30259 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30260 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.01 

30260 

A 

1 

13 

93 

1.59 

0.46 

1.33 

0.11 

30260 

B 

0 

1 

7 

0.90 

0.00 

1.32 

-0.11 

30260 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30260 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

30261 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

- 0.05 

30261 

A 

1 

18 

95 

2.13 

0.41 

1.29 

0.39 

30261 

B 

0 

1 

5 

- 0.99 

0.00 

0.26 

- 0.39 

30261 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30261 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30262 

* 

-1 

1295 

98 

1.37 

0.04 

0.00 

- 0.05 

30262 

A 

1 

21 

88 

2.24 

0.34 

0.86 

0.45 

30262 

B 

0 

2 

8 

- 0.21 

0.27 

0.31 

- 0.41 

30262 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30262 

D 

0 

1 

4 

0.68 

0.00 

0.72 

- 0.17 

30264 

* 

-1 

1309 

99 

1.38 

0.04 

0.00 

- 0.05 

30264 

A 

-1 

10 

100 

2.33 

0.42 

0.00 

0.00 

30264 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30264 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30264 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

* 

-1 

1298 

98 

1.37 

0.04 

0.00 

- 0.06 

30265 

A 

1 

20 

95 

2.29 

0.34 

0.51 

0.56 

30265 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

D 

0 

1 

5 

- 2.37 

0.00 

0.06 

- 0.56 

30266 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

30266 

A 

1 

15 

83 

1.46 

0.37 

0.84 

0.40 

30266 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30266 

C 

0 

1 

6 

- 1.03 

0.00 

0.21 

- 0.36 

30266 

D 

0 

2 

11 

0.32 

1.45 

1.84 

- 0.21 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

30267 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

- 0.01 

30267 

A 

-1 

17 

100 

1.48 

0.37 

0.00 

0.00 

30267 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30268 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

- 0.02 

30268 

A 

1 

19 

95 

1.71 

0.41 

1.11 

0.19 

30268 

B 

0 

1 

5 

0.19 

0.00 

0.80 

- 0.19 

30268 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30268 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30269 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

- 0.03 

30269 

A 

1 

11 

79 

1.99 

0.48 

1.29 

0.25 

30269 

B 

0 

2 

14 

1.17 

0.14 

1.01 

- 0.19 

30269 

C 

0 

1 

7 

1.15 

0.00 

0.99 

- 0.13 

30269 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

* 

-1 

1306 

99 

1.39 

0.04 

0.00 

0.05 

30271 

A 

1 

11 

85 

1.36 

0.30 

0.82 

0.78 

30271 

B 

0 

1 

8 

- 0.70 

0.00 

0.24 

- 0.21 

30271 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

D 

0 

1 

8 

- 5.12 

0.00 

0.00 

- 0.86 

30272 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.04 

30272 

A 

-1 

15 

100 

0.79 

0.37 

0.00 

0.00 

30272 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30272 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30272 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30273 

* 

-1 

1304 

99 

1.37 

0.04 

0.00 

-0.08 

30273 

A 

-1 

15 

100 

2.57 

0.40 

0.00 

0.00 

30273 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30273 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30273 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30274 

* 

-1 

1205 

91 

1.40 

0.04 

0.00 

0.04 

30274 

A 

1 

106 

93 

1.28 

0.12 

0.91 

0.33 

30274 

B 

0 

2 

2 

-0.85 

0.98 

0.35 

-0.21 

30274 

C 

0 

6 

5 

-0.22 

0.43 

0.83 

-0.26 

30274 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30276 

* 

-1 

816 

62 

1.32 

0.05 

0.00 

-0.05 

30276 

A 

1 

377 

75 

1.99 

0.08 

1.19 

0.48 

30276 

B 

0 

41 

8 

-0.06 

0.26 

0.86 

-0.25 

30276 

C 

0 

31 

6 

0.49 

0.20 

1.22 

-0.14 

30276 

D 

0 

54 

11 

-0.29 

0.23 

0.80 

-0.34 

30289 

* 

-1 

818 

62 

1.31 

0.05 

0.00 

-0.06 

30289 

A 

1 

395 

79 

1.93 

0.08 

1.13 

0.46 

30289 

B 

0 

32 

6 

0.16 

0.13 

0.71 

-0.19 

30289 

C 

0 

33 

7 

0.10 

0.36 

1.72 

-0.21 

30289 

D 

0 

41 

8 

-0.50 

0.28 

0.79 

-0.33 

30309 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.02 

30309 

A 

1 

9 

60 

1.49 

0.64 

1.33 

0.26 

30309 

B 

0 

2 

13 

1.01 

2.85 

12.91 

-0.01 

30309 

C 

0 

3 

20 

0.91 

0.48 

1.73 

-0.04 

30309 

D 

0 

1 

7 

-2.24 

0.00 

0.06 

-0.44 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30401 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.05 

30401 

A 

1 

12 

80 

1.66 

0.44 

0.56 

0.77 

30401 

B 

0 

2 

13 

-2.22 

1.92 

0.35 

-0.46 

30401 

C 

0 

1 

7 

-5.01 

0.00 

0.00 

-0.61 

30401 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30403 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

30403 

A 

1 

15 

83 

1.47 

0.48 

0.79 

0.63 

30403 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30403 

C 

0 

1 

6 

-0.47 

0.00 

0.64 

-0.14 

30403 

D 

0 

2 

11 

-3.34 

1.24 

0.13 

-0.64 

30405 

* 

-1 

1304 

99 

1.38 

0.04 

0.00 

0.00 

30405 

A 

1 

11 

73 

1.93 

0.37 

0.60 

0.65 

30405 

B 

0 

2 

13 

0.42 

0.34 

0.66 

-0.23 

30405 

C 

0 

1 

7 

0.05 

0.00 

0.43 

-0.22 

30405 

D 

0 

1 

7 

-2.24 

0.00 

0.04 

-0.62 

30406 

* 

-1 

1299 

98 

1.37 

0.04 

0.00 

-0.06 

30406 

A 

1 

14 

70 

2.79 

0.43 

0.89 

0.57 

30406 

B 

0 

4 

20 

0.24 

0.32 

0.38 

-0.58 

30406 

C 

0 

2 

10 

1.66 

0.36 

1.42 

-0.10 

30406 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30407 

* 

-1 

1309 

99 

1.38 

0.04 

0.00 

-0.01 

30407 

A 

1 

6 

60 

2.34 

0.34 

0.53 

0.79 

30407 

B 

0 

3 

30 

0.62 

0.41 

0.50 

-0.59 

30407 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30407 

D 

0 

1 

10 

0.27 

0.00 

0.29 

-0.40 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30408 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.02 

30408 

A 

1 

13 

65 

2.33 

0.44 

0.77 

0.64 

30408 

B 

0 

3 

15 

0.95 

0.74 

1.45 

-0.02 

30408 

C 

0 

3 

15 

-1.92 

1.55 

0.22 

-0.48 

30408 

D 

0 

1 

5 

-5.41 

0.00 

0.00 

-0.57 

30410 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

30410 

A 

1 

6 

32 

1.99 

0.54 

0.75 

0.47 

30410 

B 

0 

10 

53 

0.62 

0.49 

1.85 

-0.23 

30410 

C 

0 

2 

11 

0.41 

0.89 

0.73 

-0.12 

30410 

D 

0 

1 

5 

-1.01 

0.00 

0.12 

-0.30 

30412 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.01 

30412 

A 

1 

15 

65 

2.76 

0.36 

0.59 

0.77 

30412 

B 

0 

2 

9 

0.10 

0.61 

0.46 

-0.18 

30412 

C 

0 

4 

17 

-0.30 

0.52 

0.37 

-0.34 

30412 

D 

0 

2 

9 

-3.61 

1.40 

0.04 

-0.66 

30413 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

30413 

A 

1 

15 

79 

2.49 

0.35 

0.77 

0.60 

30413 

B 

0 

1 

5 

1.40 

0.00 

1.08 

-0.10 

30413 

C 

0 

3 

16 

-0.11 

0.28 

0.26 

-0.61 

30413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30414 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

30414 

A 

1 

13 

68 

2.18 

0.52 

1.33 

0.46 

30414 

B 

0 

1 

5 

-0.88 

0.00 

0.17 

-0.31 

30414 

C 

0 

2 

11 

1.54 

0.65 

2.33 

-0.01 

30414 

D 

0 

3 

16 

-0.08 

0.97 

0.96 

-0.39 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30418 

* 

-1 

1310 

99 

1.39 

0.04 

0.00 

0.04 

30418 

A 

1 

4 

44 

2.40 

0.41 

0.46 

0.66 

30418 

B 

0 

1 

11 

0.22 

0.00 

0.31 

-0.08 

30418 

C 

0 

2 

22 

0.71 

0.44 

0.55 

-0.01 

30418 

D 

0 

2 

22 

-2.31 

2.61 

0.33 

-0.72 

30419 

* 

-1 

1310 

99 

1.38 

0.04 

0.00 

0.00 

30419 

A 

1 

4 

44 

1.99 

1.09 

1.83 

0.33 

30419 

B 

0 

3 

33 

0.88 

1.38 

4.30 

-0.18 

30419 

C 

0 

1 

11 

0.22 

0.00 

0.44 

-0.22 

30419 

D 

0 

1 

11 

1.17 

0.00 

1.13 

-0.03 

30421 

* 

-1 

1219 

92 

1.39 

0.04 

0.00 

0.03 

30421 

A 

1 

77 

77 

1.48 

0.14 

0.94 

0.36 

30421 

B 

0 

16 

16 

0.51 

0.18 

0.86 

-0.26 

30421 

C 

0 

7 

7 

0.25 

0.37 

0.76 

-0.22 

30421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30458 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.06 

30458 

A 

1 

11 

69 

2.51 

0.51 

1.41 

0.28 

30458 

B 

0 

4 

25 

1.94 

0.69 

2.71 

-0.10 

30458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30458 

D 

0 

1 

6 

-0.06 

0.00 

0.21 

-0.37 

30459 

* 

-1 

1305 

99 

1.37 

0.04 

0.00 

-0.08 

30459 

A 

1 

7 

50 

4.30 

0.59 

0.90 

0.78 

30459 

B 

0 

3 

21 

1.57 

0.99 

2.07 

-0.23 

30459 

C 

0 

2 

14 

1.13 

0.02 

0.61 

-0.26 

30459 

D 

0 

2 

14 

-0.56 

0.81 

0.15 

-0.57 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30502 

* 

-1 

1220 

92 

1.40 

0.04 

0.00 

0.03 

30502 

A 

1 

41 

41 

1.92 

0.25 

1.38 

0.45 

30502 

B 

0 

29 

29 

0.48 

0.17 

0.75 

-0.34 

30502 

C 

0 

29 

29 

0.89 

0.15 

1.00 

-0.15 

30502 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30511 

* 

-1 

1194 

91 

1.35 

0.04 

0.00 

-0.07 

30511 

A 

1 

93 

74 

1.98 

0.13 

1.09 

0.37 

30511 

B 

0 

13 

10 

0.59 

0.35 

0.81 

-0.29 

30511 

C 

0 

14 

11 

1.34 

0.16 

1.22 

-0.10 

30511 

D 

0 

5 

4 

0.25 

0.58 

0.60 

-0.23 

30512 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

0.01 

30512 

A 

1 

13 

93 

1.48 

0.55 

0.79 

0.42 

30512 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30512 

C 

0 

1 

7 

-1.83 

0.00 

0.18 

-0.42 

30512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30514 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

30514 

A 

1 

14 

78 

1.86 

0.53 

1.05 

0.44 

30514 

B 

0 

1 

6 

1.45 

0.00 

2.88 

0.01 

30514 

C 

0 

1 

6 

0.25 

0.00 

0.86 

-0.14 

30514 

D 

0 

2 

11 

-1.26 

0.37 

0.20 

-0.48 

30515 

* 

-1 

1308 

99 

1.39 

0.04 

0.00 

0.02 

30515 

A 

1 

6 

55 

1.69 

0.42 

0.96 

0.45 

30515 

B 

0 

1 

9 

-0.72 

0.00 

0.15 

-0.37 

30515 

C 

0 

1 

9 

0.90 

0.00 

0.76 

-0.04 

30515 

D 

0 

3 

27 

0.47 

1.48 

1.47 

-0.24 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30516 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

30516 

A 

1 

13 

68 

1.75 

0.39 

0.80 

0.52 

30516 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30516 

C 

0 

3 

16 

0.93 

0.58 

1.65 

-0.06 

30516 

D 

0 

3 

16 

-1.21 

1.13 

0.39 

-0.60 

30517 

* 

-1 

1298 

98 

1.38 

0.04 

0.00 

0.00 

30517 

A 

1 

12 

57 

1.86 

0.35 

1.23 

0.48 

30517 

B 

0 

2 

10 

0.47 

0.28 

0.49 

-0.26 

30517 

C 

0 

4 

19 

0.76 

0.15 

0.65 

-0.27 

30517 

D 

0 

3 

14 

0.96 

0.75 

1.14 

-0.16 

30518 

* 

-1 

1200 

91 

1.38 

0.04 

0.00 

-0.01 

30518 

A 

1 

106 

89 

1.55 

0.12 

0.97 

0.33 

30518 

B 

0 

9 

8 

0.30 

0.26 

0.72 

-0.26 

30518 

C 

0 

3 

3 

0.97 

0.34 

1.20 

-0.06 

30518 

D 

0 

1 

1 

-2.36 

0.00 

0.04 

-0.28 

30519 

* 

-1 

1309 

99 

1.39 

0.04 

0.00 

0.05 

30519 

A 

1 

7 

70 

1.29 

0.88 

1.39 

0.50 

30519 

B 

0 

1 

10 

0.54 

0.00 

1.58 

0.01 

30519 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30519 

D 

0 

2 

20 

-2.56 

2.35 

0.75 

-0.58 

30520 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

30520 

A 

1 

13 

65 

2.15 

0.33 

0.67 

0.71 

30520 

B 

0 

5 

25 

0.09 

0.20 

0.38 

-0.55 

30520 

C 

0 

1 

5 

-0.88 

0.00 

0.13 

-0.38 

30520 

D 

0 

1 

5 

1.01 

0.00 

0.88 

-0.07 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30551 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

30551 

A 

1 

10 

59 

2.32 

0.36 

0.62 

0.70 

30551 

B 

0 

4 

24 

0.53 

0.31 

0.52 

-0.34 

30551 

C 

0 

3 

18 

-0.23 

0.89 

0.41 

-0.53 

30551 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30552 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

30552 

A 

1 

12 

67 

1.46 

0.31 

1.03 

0.50 

30552 

B 

0 

3 

17 

0.99 

0.23 

1.17 

-0.01 

30552 

C 

0 

1 

6 

0.07 

0.00 

0.44 

-0.19 

30552 

D 

0 

2 

11 

-1.08 

1.13 

0.24 

-0.60 

30553 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

30553 

A 

1 

11 

55 

1.80 

0.59 

1.54 

0.26 

30553 

B 

0 

5 

25 

0.76 

0.51 

1.72 

-0.25 

30553 

C 

0 

1 

5 

0.76 

0.00 

0.89 

-0.10 

30553 

D 

0 

3 

15 

1.43 

0.38 

1.98 

0.00 

30554 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

30554 

A 

1 

10 

53 

2.56 

0.35 

0.72 

0.59 

30554 

B 

0 

3 

16 

1.30 

0.95 

1.68 

-0.19 

30554 

C 

0 

2 

11 

0.69 

0.45 

0.41 

-0.32 

30554 

D 

0 

4 

21 

1.09 

0.41 

0.71 

-0.32 

30555 

* 

-1 

1306 

99 

1.37 

0.04 

0.00 

-0.05 

30555 

A 

1 

5 

38 

4.33 

0.41 

0.23 

0.84 

30555 

B 

0 

4 

31 

1.26 

0.48 

0.58 

-0.31 

30555 

C 

0 

2 

15 

0.78 

1.92 

0.85 

-0.30 

30555 

D 

0 

2 

15 

0.10 

0.29 

0.13 

-0.44 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30556 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

30556 

A 

1 

9 

47 

1.49 

0.35 

1.06 

0.42 

30556 

B 

0 

1 

5 

2.35 

0.00 

3.70 

0.29 

30556 

C 

0 

5 

26 

0.56 

0.36 

0.76 

-0.24 

30556 

D 

0 

4 

21 

0.14 

0.52 

0.60 

-0.41 

30557 

* 

-1 

1299 

98 

1.37 

0.04 

0.00 

-0.06 

30557 

A 

1 

17 

85 

2.43 

0.26 

0.68 

0.62 

30557 

B 

0 

2 

10 

0.00 

1.09 

0.39 

-0.54 

30557 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30557 

D 

0 

1 

5 

0.54 

0.00 

0.41 

-0.27 

30558 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.05 

30558 

A 

1 

8 

42 

1.84 

0.30 

0.66 

0.50 

30558 

B 

0 

4 

21 

0.78 

0.57 

1.08 

0.00 

30558 

C 

0 

5 

26 

0.84 

0.46 

1.02 

0.02 

30558 

D 

0 

2 

11 

-3.54 

0.60 

0.01 

-0.83 

30559 

* 

-1 

1294 

98 

1.38 

0.04 

0.00 

-0.02 

30559 

A 

1 

17 

68 

2.18 

0.36 

1.11 

0.59 

30559 

B 

0 

6 

24 

0.47 

0.26 

0.72 

-0.39 

30559 

C 

0 

1 

4 

0.05 

0.00 

0.41 

-0.20 

30559 

D 

0 

1 

4 

-1.14 

0.00 

0.13 

-0.35 

30560 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

30560 

A 

1 

7 

44 

3.26 

0.53 

0.46 

0.77 

30560 

B 

0 

4 

25 

0.98 

0.49 

0.85 

-0.18 

30560 

C 

0 

1 

6 

1.69 

0.00 

1.32 

0.01 

30560 

D 

0 

4 

25 

-0.77 

0.25 

0.13 

-0.71 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30561 

* 

-1 

1299 

98 

1.37 

0.04 

0.00 

-0.06 

30561 

A 

1 

14 

70 

2.80 

0.48 

1.15 

0.56 

30561 

B 

0 

3 

15 

0.92 

0.78 

1.21 

-0.27 

30561 

C 

0 

2 

10 

0.11 

0.05 

0.34 

-0.36 

30561 

D 

0 

1 

5 

0.22 

0.00 

0.38 

-0.24 

30562 

* 

-1 

1308 

99 

1.38 

0.04 

0.00 

-0.05 

30562 

A 

1 

8 

73 

2.57 

0.70 

1.42 

0.36 

30562 

B 

0 

3 

27 

1.16 

0.58 

1.34 

-0.36 

30562 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30562 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30563 

* 

-1 

1306 

99 

1.38 

0.04 

0.00 

-0.04 

30563 

A 

1 

9 

69 

2.59 

0.48 

0.66 

0.61 

30563 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30563 

C 

0 

3 

23 

0.91 

0.21 

0.65 

-0.40 

30563 

D 

0 

1 

8 

-0.19 

0.00 

0.21 

-0.43 

30564 

* 

-1 

1308 

99 

1.37 

0.04 

0.00 

-0.08 

30564 

A 

1 

6 

55 

3.38 

0.37 

0.61 

0.70 

30564 

B 

0 

2 

18 

0.96 

0.90 

0.37 

-0.67 

30564 

C 

0 

2 

18 

2.33 

0.05 

1.02 

-0.12 

30564 

D 

0 

1 

9 

2.04 

0.00 

0.76 

-0.16 

30579 

* 

-1 

1297 

98 

1.38 

0.04 

0.00 

-0.03 

30579 

A 

1 

15 

68 

2.47 

0.35 

0.57 

0.68 

30579 

B 

0 

3 

14 

0.74 

0.54 

0.86 

-0.23 

30579 

C 

0 

2 

9 

-0.57 

0.73 

0.23 

-0.43 

30579 

D 

0 

2 

9 

-0.44 

0.68 

0.25 

-0.41 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30580 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.02 

30580 

A 

1 

15 

75 

2.07 

0.42 

1.06 

0.53 

30580 

B 

0 

2 

10 

0.08 

0.02 

0.44 

-0.31 

30580 

C 

0 

2 

10 

-0.33 

0.13 

0.29 

-0.39 

30580 

D 

0 

1 

5 

0.99 

0.00 

1.08 

-0.08 

30583 

* 

-1 

1297 

98 

1.37 

0.04 

0.00 

-0.05 

30583 

A 

1 

14 

64 

2.71 

0.26 

0.65 

0.66 

30583 

B 

0 

4 

18 

0.63 

0.48 

0.40 

-0.42 

30583 

C 

0 

3 

14 

1.63 

0.54 

1.13 

-0.09 

30583 

D 

0 

1 

5 

-2.21 

0.00 

0.02 

-0.61 

30601 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.06 

30601 

A 

1 

11 

69 

2.85 

0.46 

0.82 

0.59 

30601 

B 

0 

1 

6 

-0.19 

0.00 

0.17 

-0.40 

30601 

C 

0 

1 

6 

0.87 

0.00 

0.48 

-0.22 

30601 

D 

0 

3 

19 

1.18 

0.36 

0.75 

-0.32 

30602 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.02 

30602 

A 

1 

7 

44 

2.53 

0.51 

0.84 

0.53 

30602 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30602 

C 

0 

2 

13 

1.06 

0.40 

0.65 

-0.01 

30602 

D 

0 

7 

44 

-0.27 

1.08 

1.20 

-0.52 

30603 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

30603 

A 

1 

10 

63 

2.64 

0.55 

1.12 

0.53 

30603 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30603 

C 

0 

3 

19 

-1.29 

1.93 

0.59 

-0.60 

30603 

D 

0 

3 

19 

1.40 

0.84 

1.68 

-0.06 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30615 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

30615 

A 

1 

9 

56 

2.27 

0.50 

0.92 

0.49 

30615 

B 

0 

3 

19 

0.86 

0.55 

0.91 

-0.32 

30615 

C 

0 

2 

13 

1.30 

0.01 

1.01 

-0.12 

30615 

D 

0 

2 

13 

0.92 

0.18 

0.71 

-0.23 

30617 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

30617 

A 

1 

14 

70 

1.72 

0.43 

1.24 

0.37 

30617 

B 

0 

1 

5 

1.34 

0.00 

1.78 

0.00 

30617 

C 

0 

3 

15 

1.15 

0.18 

1.51 

-0.05 

30617 

D 

0 

2 

10 

-1.07 

1.03 

0.25 

-0.51 

30621 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

0.01 

30621 

A 

1 

12 

75 

1.54 

0.29 

0.96 

0.45 

30621 

B 

0 

1 

6 

0.82 

0.00 

0.78 

-0.13 

30621 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30621 

D 

0 

3 

19 

0.47 

0.16 

0.56 

-0.42 

30701 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

30701 

A 

1 

16 

84 

1.63 

0.46 

0.86 

0.44 

30701 

B 

0 

2 

11 

-0.26 

0.62 

0.75 

-0.28 

30701 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30701 

D 

0 

1 

5 

-1.38 

0.00 

0.20 

-0.33 

30702 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

30702 

A 

1 

10 

63 

2.53 

0.70 

0.82 

0.57 

30702 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30702 

C 

0 

4 

25 

0.52 

0.52 

1.67 

-0.27 

30702 

D 

0 

2 

13 

-1.26 

0.37 

0.20 

-0.48 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30703 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.03 

30703 

A 

1 

12 

80 

1.48 

0.40 

0.66 

0.64 

30703 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30703 

C 

0 

2 

13 

-0.59 

0.11 

0.43 

-0.38 

30703 

D 

0 

1 

7 

-2.09 

0.00 

0.09 

-0.51 

30704 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.03 

30704 

A 

1 

8 

50 

2.97 

0.50 

0.55 

0.72 

30704 

B 

0 

7 

44 

0.34 

0.41 

0.49 

-0.72 

30704 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30704 

D 

0 

1 

6 

1.55 

0.00 

1.01 

-0.03 

30705 

* 

-1 

1310 

99 

1.39 

0.04 

0.00 

0.09 

30705 

A 

1 

6 

67 

0.15 

0.56 

1.02 

0.46 

30705 

B 

0 

2 

22 

-0.38 

0.65 

1.46 

-0.02 

30705 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30705 

D 

0 

1 

11 

-3.08 

0.00 

0.08 

-0.66 

30706 

* 

-1 

1306 

99 

1.39 

0.04 

0.00 

0.08 

30706 

A 

1 

9 

69 

0.96 

0.50 

1.15 

0.56 

30706 

B 

0 

2 

15 

-0.75 

0.27 

0.40 

-0.20 

30706 

C 

0 

2 

15 

-2.20 

2.81 

1.50 

-0.51 

30706 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30707 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

30707 

A 

1 

11 

61 

1.87 

0.39 

0.66 

0.62 

30707 

B 

0 

3 

17 

0.52 

0.83 

1.42 

-0.20 

30707 

C 

0 

4 

22 

-0.27 

0.27 

0.36 

-0.54 

30707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30709 

* 

-1 

1306 

99 

1.39 

0.04 

0.00 

0.05 

30709 

A 

1 

9 

69 

0.59 

0.38 

1.49 

-0.11 

30709 

B 

0 

2 

15 

1.07 

0.27 

1.83 

0.19 

30709 

C 

0 

1 

8 

0.02 

0.00 

0.62 

-0.19 

30709 

D 

0 

1 

8 

1.09 

0.00 

1.80 

0.13 

30710 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.04 

30710 

A 

1 

11 

69 

2.27 

0.53 

1.50 

0.28 

30710 

B 

0 

2 

13 

-0.49 

2.59 

1.34 

-0.45 

30710 

C 

0 

3 

19 

2.07 

1.15 

5.68 

0.04 

30710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30711 

* 

-1 

1304 

99 

1.38 

0.04 

0.00 

-0.01 

30711 

A 

1 

10 

67 

2.56 

0.51 

0.59 

0.74 

30711 

B 

0 

2 

13 

-0.04 

0.36 

0.47 

-0.32 

30711 

C 

0 

2 

13 

-0.73 

0.93 

0.32 

-0.46 

30711 

D 

0 

1 

7 

-0.97 

0.00 

0.17 

-0.34 

30714 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.03 

30714 

A 

1 

11 

69 

2.35 

0.63 

1.47 

0.40 

30714 

B 

0 

1 

6 

0.75 

0.00 

0.81 

-0.16 

30714 

C 

0 

3 

19 

0.58 

0.22 

0.72 

-0.34 

30714 

D 

0 

1 

6 

1.30 

0.00 

1.41 

-0.08 

30715 

* 

-1 

1215 

92 

1.39 

0.04 

0.00 

0.02 

30715 

A 

1 

89 

86 

1.38 

0.12 

1.06 

0.26 

30715 

B 

0 

3 

3 

0.92 

0.24 

1.13 

-0.05 

30715 

C 

0 

12 

12 

0.43 

0.19 

0.78 

-0.26 

30715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30716 

* 

-1 

1305 

99 

1.38 

0.04 

0.00 

-0.04 

30716 

A 

1 

10 

71 

2.39 

0.52 

1.05 

0.47 

30716 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

D 

0 

4 

29 

0.74 

0.46 

0.74 

-0.47 

30717 

* 

-1 

1308 

99 

1.38 

0.04 

0.00 

0.00 

30717 

A 

1 

8 

73 

1.92 

0.52 

0.78 

0.60 

30717 

B 

0 

1 

9 

-0.02 

0.00 

0.45 

-0.28 

30717 

C 

0 

1 

9 

0.68 

0.00 

0.90 

-0.14 

30717 

D 

0 

1 

9 

-1.14 

0.00 

0.15 

-0.51 

30718 

* 

-1 

1201 

91 

1.37 

0.04 

0.00 

-0.03 

30718 

A 

1 

103 

87 

1.63 

0.13 

1.12 

0.22 

30718 

B 

0 

6 

5 

0.46 

0.34 

0.75 

-0.19 

30718 

C 

0 

9 

8 

1.00 

0.27 

1.31 

-0.12 

30718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30724 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

30724 

A 

1 

14 

78 

1.96 

0.41 

1.28 

0.46 

30724 

B 

0 

2 

11 

0.62 

0.08 

0.69 

-0.23 

30724 

C 

0 

1 

6 

-0.62 

0.00 

0.20 

-0.36 

30724 

D 

0 

1 

6 

0.64 

0.00 

0.70 

-0.16 

30725 

* 

-1 

1204 

91 

1.38 

0.04 

0.00 

0.00 

30725 

A 

1 

100 

87 

1.63 

0.11 

0.98 

0.44 

30725 

B 

0 

5 

4 

-0.64 

1.21 

1.15 

-0.33 

30725 

C 

0 

9 

8 

0.27 

0.21 

0.58 

-0.25 

30725 

D 

0 

1 

1 

-1.12 

0.00 

0.12 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30756 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.02 

30756 

A 

1 

7 

35 

1.66 

0.77 

3.57 

0.20 

30756 

B 

0 

5 

25 

1.13 

0.46 

1.09 

0.00 

30756 

C 

0 

4 

20 

1.80 

0.46 

1.87 

0.17 

30756 

D 

0 

4 

20 

-0.46 

1.58 

0.84 

-0.41 

30757 

* 

-1 

1306 

99 

1.39 

0.04 

0.00 

0.01 

30757 

A 

1 

6 

46 

2.15 

0.39 

0.88 

0.46 

30757 

B 

0 

1 

8 

0.06 

0.00 

0.20 

-0.16 

30757 

C 

0 

2 

15 

0.13 

0.44 

0.24 

-0.23 

30757 

D 

0 

4 

31 

0.49 

1.68 

2.06 

-0.23 

30758 

* 

-1 

1297 

98 

1.38 

0.04 

0.00 

0.01 

30758 

A 

1 

13 

59 

1.60 

0.55 

2.90 

0.21 

30758 

B 

0 

5 

23 

1.69 

0.50 

4.18 

0.12 

30758 

C 

0 

2 

9 

0.32 

0.20 

0.57 

-0.18 

30758 

D 

0 

2 

9 

-0.55 

0.34 

0.25 

-0.35 

30760 

* 

-1 

1299 

98 

1.37 

0.04 

0.00 

-0.09 

30760 

A 

1 

15 

75 

3.47 

0.39 

0.73 

0.68 

30760 

B 

0 

2 

10 

-3.17 

1.88 

0.05 

-0.75 

30760 

C 

0 

1 

5 

2.86 

0.00 

3.31 

0.03 

30760 

D 

0 

2 

10 

0.63 

0.24 

0.37 

-0.25 

30761 

* 

-1 

1304 

99 

1.38 

0.04 

0.00 

0.01 

30761 

A 

1 

10 

67 

2.31 

0.65 

0.91 

0.59 

30761 

B 

0 

1 

7 

-1.01 

0.00 

0.19 

-0.25 

30761 

C 

0 

1 

7 

0.94 

0.00 

1.35 

-0.04 

30761 

D 

0 

3 

20 

-1.23 

1.64 

0.97 

-0.52 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30851 

* 

-1 

1197 

91 

1.38 

0.04 

0.00 

0.00 

30851 

A 

1 

94 

77 

1.69 

0.11 

0.90 

0.47 

30851 

B 

0 

15 

12 

0.73 

0.23 

1.12 

-0.20 

30851 

C 

0 

9 

7 

-0.12 

0.25 

0.39 

-0.35 

30851 

D 

0 

4 

3 

-0.22 

0.89 

0.81 

-0.24 

30852 

* 

-1 

1297 

98 

1.39 

0.04 

0.00 

0.01 

30852 

A 

1 

13 

59 

1.98 

0.34 

0.77 

0.65 

30852 

B 

0 

5 

23 

0.58 

0.42 

0.86 

-0.24 

30852 

C 

0 

3 

14 

-0.27 

0.24 

0.29 

-0.42 

30852 

D 

0 

1 

5 

-1.08 

0.00 

0.12 

-0.36 

30853 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

30853 

A 

1 

8 

42 

2.57 

0.69 

1.47 

0.49 

30853 

B 

0 

5 

26 

0.69 

0.43 

0.59 

-0.28 

30853 

C 

0 

2 

11 

3.00 

0.68 

5.56 

0.28 

30853 

D 

0 

4 

21 

-0.26 

0.36 

0.21 

-0.51 

30854 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.03 

30854 

A 

1 

10 

67 

1.15 

0.51 

1.37 

0.13 

30854 

B 

0 

3 

20 

0.93 

0.62 

1.98 

-0.03 

30854 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30854 

D 

0 

2 

13 

0.51 

1.80 

2.87 

-0.14 

30855 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

30855 

A 

1 

10 

56 

1.82 

0.41 

1.25 

0.37 

30855 

B 

0 

4 

22 

-0.48 

1.39 

0.78 

-0.48 

30855 

C 

0 

4 

22 

1.30 

0.93 

2.78 

0.03 

30855 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30856 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

30856 

A 

1 

10 

50 

1.23 

0.27 

1.54 

-0.10 

30856 

B 

0 

5 

25 

0.94 

0.29 

0.77 

-0.20 

30856 

C 

0 

2 

10 

2.75 

0.49 

4.41 

0.38 

30856 

D 

0 

3 

15 

1.54 

1.60 

4.10 

0.06 

30864 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

30864 

A 

1 

14 

78 

1.70 

0.47 

1.83 

0.15 

30864 

B 

0 

3 

17 

1.09 

0.46 

1.44 

-0.14 

30864 

C 

0 

1 

6 

1.34 

0.00 

1.52 

-0.04 

30864 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30865 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

30865 

A 

1 

12 

71 

1.20 

0.42 

1.15 

0.31 

30865 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30865 

C 

0 

5 

29 

0.21 

0.67 

1.54 

-0.31 

30865 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30871 

* 

-1 

1300 

99 

1.40 

0.04 

0.00 

0.07 

30871 

A 

1 

6 

32 

1.97 

0.68 

0.89 

0.51 

30871 

B 

0 

3 

16 

1.06 

0.61 

1.68 

0.12 

30871 

C 

0 

8 

42 

-0.69 

0.69 

0.52 

-0.55 

30871 

D 

0 

2 

11 

0.40 

0.91 

0.92 

-0.03 

30872 

* 

-1 

1307 

99 

1.38 

0.04 

0.00 

-0.02 

30872 

A 

1 

9 

75 

2.28 

0.54 

0.91 

0.63 

30872 

B 

0 

2 

17 

-0.40 

0.21 

0.31 

-0.54 

30872 

C 

0 

1 

8 

0.14 

0.00 

0.52 

-0.27 

30872 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30873 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.01 

30873 

A 

1 

22 

96 

1.63 

0.33 

0.95 

0.26 

30873 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30873 

C 

0 

1 

4 

-0.31 

0.00 

0.37 

-0.26 

30873 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30874 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

30874 

A 

1 

14 

78 

1.91 

0.45 

1.03 

0.36 

30874 

B 

0 

3 

17 

1.06 

0.79 

2.48 

-0.14 

30874 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30874 

D 

0 

1 

6 

-1.38 

0.00 

0.11 

-0.42 

30884 

* 

-1 

1307 

99 

1.38 

0.04 

0.00 

-0.01 

30884 

A 

1 

7 

58 

2.58 

0.36 

0.45 

0.81 

30884 

B 

0 

2 

17 

0.78 

0.97 

0.79 

-0.24 

30884 

C 

0 

1 

8 

-0.56 

0.00 

0.14 

-0.44 

30884 

D 

0 

2 

17 

-0.05 

0.01 

0.23 

-0.50 

31001 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

31001 

A 

1 

13 

72 

2.46 

0.37 

0.52 

0.73 

31001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31001 

C 

0 

3 

17 

0.09 

0.21 

0.40 

-0.43 

31001 

D 

0 

2 

11 

-0.79 

0.59 

0.19 

-0.53 

31006 

* 

-1 

1290 

98 

1.38 

0.04 

0.00 

-0.01 

31006 

A 

1 

19 

66 

2.12 

0.33 

0.79 

0.50 

31006 

B 

0 

5 

17 

-0.30 

0.64 

0.48 

-0.51 

31006 

C 

0 

4 

14 

1.67 

0.33 

2.16 

0.03 

31006 

D 

0 

1 

3 

-1.13 

0.00 

0.11 

-0.31 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31012 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

31012 

A 

1 

8 

47 

2.64 

0.71 

1.39 

0.46 

31012 

B 

0 

3 

18 

1.52 

0.34 

1.17 

-0.08 

31012 

C 

0 

4 

24 

1.00 

0.62 

1.00 

-0.26 

31012 

D 

0 

2 

12 

0.43 

1.56 

0.88 

-0.29 

31013 

* 

-1 

1297 

98 

1.39 

0.04 

0.00 

0.02 

31013 

A 

1 

14 

64 

1.93 

0.30 

0.64 

0.61 

31013 

B 

0 

2 

9 

2.36 

0.36 

4.33 

0.23 

31013 

C 

0 

2 

9 

0.06 

0.16 

0.41 

-0.22 

31013 

D 

0 

4 

18 

-1.48 

0.21 

0.09 

-0.77 

31014 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.04 

31014 

A 

1 

8 

50 

1.85 

0.35 

0.73 

0.57 

31014 

B 

0 

4 

25 

0.61 

0.53 

0.88 

-0.06 

31014 

C 

0 

3 

19 

-0.02 

1.02 

0.87 

-0.21 

31014 

D 

0 

1 

6 

-4.40 

0.00 

0.00 

-0.73 

31015 

* 

-1 

1293 

98 

1.37 

0.04 

0.00 

-0.04 

31015 

A 

1 

22 

85 

2.03 

0.31 

1.02 

0.35 

31015 

B 

0 

1 

4 

2.79 

0.00 

5.74 

0.13 

31015 

C 

0 

1 

4 

-0.41 

0.00 

0.23 

-0.29 

31015 

D 

0 

2 

8 

-0.09 

0.16 

0.33 

-0.36 

31016 

* 

-1 

1310 

99 

1.38 

0.04 

0.00 

0.01 

31016 

A 

1 

6 

67 

1.78 

0.78 

1.11 

0.46 

31016 

B 

0 

1 

11 

0.66 

0.00 

1.06 

-0.13 

31016 

C 

0 

2 

22 

-0.03 

0.09 

0.53 

-0.42 

31016 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31018 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.06 

31018 

A 

1 

5 

26 

1.68 

0.93 

1.41 

0.38 

31018 

B 

0 

6 

32 

0.87 

0.37 

1.50 

0.10 

31018 

C 

0 

6 

32 

-0.22 

0.71 

0.95 

-0.36 

31018 

D 

0 

2 

11 

-0.06 

1.07 

0.69 

-0.15 

31019 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.03 

31019 

A 

1 

13 

87 

1.35 

0.43 

1.19 

0.47 

31019 

B 

0 

1 

7 

1.93 

0.00 

3.61 

0.12 

31019 

C 

0 

1 

7 

-5.05 

0.00 

0.00 

-0.76 

31019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31020 

* 

-1 

1208 

92 

1.39 

0.04 

0.00 

0.02 

31020 

A 

1 

48 

43 

1.82 

0.19 

2.76 

0.33 

31020 

B 

0 

40 

36 

0.91 

0.17 

1.45 

-0.20 

31020 

C 

0 

21 

19 

1.20 

0.25 

1.60 

-0.03 

31020 

D 

0 

2 

2 

-3.00 

1.92 

0.09 

-0.41 

31021 

* 

-1 

1307 

99 

1.39 

0.04 

0.00 

0.02 

31021 

A 

1 

6 

50 

2.46 

0.72 

0.97 

0.56 

31021 

B 

0 

2 

17 

1.78 

1.65 

4.40 

0.13 

31021 

C 

0 

1 

8 

1.30 

0.00 

1.02 

0.03 

31021 

D 

0 

3 

25 

-2.32 

1.20 

0.14 

-0.77 

31023 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.02 

31023 

A 

1 

6 

26 

2.47 

0.71 

1.49 

0.34 

31023 

B 

0 

2 

9 

3.01 

1.33 

6.42 

0.29 

31023 

C 

0 

9 

39 

0.93 

0.33 

0.63 

-0.41 

31023 

D 

0 

6 

26 

1.47 

0.50 

1.10 

-0.08 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31024 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.04 

31024 

A 

1 

10 

63 

2.38 

0.57 

2.18 

0.40 

31024 

B 

0 

2 

13 

0.89 

0.12 

0.52 

-0.25 

31024 

C 

0 

4 

25 

1.25 

0.38 

0.91 

-0.25 

31024 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31025 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.03 

31025 

A 

1 

9 

43 

2.01 

0.57 

0.86 

0.49 

31025 

B 

0 

3 

14 

-0.95 

1.12 

0.34 

-0.43 

31025 

C 

0 

6 

29 

1.30 

0.46 

2.44 

0.11 

31025 

D 

0 

3 

14 

-0.89 

0.71 

0.24 

-0.41 

31160 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.01 

31160 

A 

1 

11 

55 

2.04 

0.40 

1.23 

0.40 

31160 

B 

0 

2 

10 

0.66 

0.02 

0.45 

-0.22 

31160 

C 

0 

7 

35 

1.04 

0.57 

1.67 

-0.28 

31160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31162 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

31162 

A 

1 

13 

72 

2.23 

0.36 

0.94 

0.44 

31162 

B 

0 

2 

11 

1.47 

0.97 

1.67 

-0.09 

31162 

C 

0 

2 

11 

1.30 

0.65 

1.15 

-0.14 

31162 

D 

0 

1 

6 

-1.29 

0.00 

0.07 

-0.55 

31163 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.02 

31163 

A 

1 

13 

65 

2.27 

0.58 

3.40 

0.37 

31163 

B 

0 

1 

5 

1.77 

0.00 

1.72 

0.01 

31163 

C 

0 

5 

25 

1.28 

0.57 

1.68 

-0.10 

31163 

D 

0 

1 

5 

-4.14 

0.00 

0.00 

-0.60 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31185 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.01 

31185 

A 

1 

17 

81 

1.70 

0.32 

0.65 

0.62 

31185 

B 

0 

1 

5 

-0.79 

0.00 

0.25 

-0.31 

31185 

C 

0 

1 

5 

-0.69 

0.00 

0.28 

-0.29 

31185 

D 

0 

2 

10 

-0.61 

0.77 

0.40 

-0.40 

31186 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.03 

31186 

A 

-1 

20 

100 

1.77 

0.44 

0.00 

0.00 

31186 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31186 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31186 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31203 

* 

-1 

1297 

98 

1.37 

0.04 

0.00 

-0.04 

31203 

A 

1 

19 

86 

2.14 

0.39 

2.26 

0.41 

31203 

B 

0 

2 

9 

0.18 

0.98 

0.77 

-0.30 

31203 

C 

0 

1 

5 

-0.15 

0.00 

0.36 

-0.25 

31203 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31205 

* 

-1 

1206 

91 

1.41 

0.04 

0.00 

0.05 

31205 

A 

1 

47 

42 

1.49 

0.14 

1.12 

0.31 

31205 

B 

0 

12 

11 

0.76 

0.32 

1.12 

-0.13 

31205 

C 

0 

53 

47 

0.86 

0.11 

1.00 

-0.26 

31205 

D 

0 

1 

1 

2.97 

0.00 

6.08 

0.18 

31206 

* 

-1 

1305 

99 

1.39 

0.04 

0.00 

0.03 

31206 

A 

1 

12 

86 

1.28 

0.39 

0.61 

0.62 

31206 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31206 

C 

0 

1 

7 

-0.72 

0.00 

0.45 

-0.28 

31206 

D 

0 

1 

7 

-2.37 

0.00 

0.09 

-0.57 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31208 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.03 

31208 

A 

1 

8 

38 

1.93 

0.29 

1.01 

0.38 

31208 

B 

0 

5 

24 

1.94 

0.57 

2.29 

0.27 

31208 

C 

0 

4 

19 

0.80 

0.51 

0.71 

-0.05 

31208 

D 

0 

4 

19 

-1.85 

1.28 

0.26 

-0.72 

31209 

* 

-1 

1294 

98 

1.38 

0.04 

0.00 

-0.01 

31209 

A 

1 

9 

36 

2.00 

0.45 

1.40 

0.36 

31209 

B 

0 

5 

20 

1.95 

0.24 

1.57 

0.22 

31209 

C 

0 

6 

24 

1.20 

0.36 

0.89 

-0.13 

31209 

D 

0 

5 

20 

0.28 

0.25 

0.31 

-0.52 

31210 

* 

-1 

1306 

99 

1.38 

0.04 

0.00 

-0.02 

31210 

A 

1 

9 

69 

2.51 

0.45 

0.63 

0.67 

31210 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31210 

C 

0 

2 

15 

0.92 

0.45 

0.89 

-0.19 

31210 

D 

0 

2 

15 

-1.05 

1.32 

0.23 

-0.67 

31212 

* 

-1 

1297 

98 

1.39 

0.04 

0.00 

0.03 

31212 

A 

1 

16 

73 

1.33 

0.33 

1.14 

0.33 

31212 

B 

0 

5 

23 

0.41 

0.54 

1.18 

-0.28 

31212 

C 

0 

1 

5 

0.22 

0.00 

0.61 

-0.15 

31212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOOOl 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

KOOOl 

A 

1 

15 

88 

2.28 

0.41 

0.66 

0.73 

KOOOl 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOOOl 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOOOl 

D 

0 

2 

12 

-3.03 

1.89 

0.14 

-0.73 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0002 

* 

-1 

1200 

91 

1.42 

0.04 

0.00 

0.07 

K0002 

A 

1 

97 

82 

1.31 

0.13 

0.88 

0.41 

K0002 

B 

0 

7 

6 

-0.11 

0.44 

0.88 

-0.22 

K0002 

C 

0 

15 

13 

-0.07 

0.17 

0.62 

-0.33 

K0002 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0003 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0003 

A 

1 

17 

94 

2.09 

0.36 

0.96 

0.39 

K0003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0003 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0003 

D 

0 

1 

6 

-0.51 

0.00 

0.23 

-0.39 

K0004 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0004 

A 

-1 

18 

100 

1.61 

0.34 

0.00 

0.00 

K0004 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0004 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0004 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0005 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0005 

A 

1 

13 

72 

2.62 

0.40 

0.86 

0.57 

K0005 

B 

0 

2 

11 

0.29 

0.80 

0.53 

-0.35 

K0005 

C 

0 

1 

6 

0.95 

0.00 

0.76 

-0.15 

K0005 

D 

0 

2 

11 

0.23 

2.33 

1.92 

-0.36 

K0006 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0006 

A 

-1 

18 

100 

2.03 

0.35 

0.00 

0.00 

K0006 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0006 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0006 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0007 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

K0007 

A 

1 

16 

84 

1.48 

0.52 

1.67 

0.21 

K0007 

B 

0 

1 

5 

-0.40 

0.00 

0.59 

-0.20 

K0007 

C 

0 

2 

11 

0.74 

1.72 

5.36 

-0.10 

K0007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0008 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0008 

A 

1 

14 

78 

2.13 

0.50 

1.30 

0.45 

K0008 

B 

0 

2 

11 

1.39 

1.56 

4.01 

-0.03 

K0008 

C 

0 

1 

6 

0.18 

0.00 

0.48 

-0.15 

K0008 

D 

0 

1 

6 

-4.07 

0.00 

0.00 

-0.62 

K0009 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0009 

A 

1 

17 

89 

1.67 

0.36 

0.81 

0.70 

K0009 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0009 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0009 

D 

0 

2 

11 

-2.98 

1.60 

0.16 

-0.70 

KOOlO 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

KOOlO 

A 

1 

14 

82 

2.47 

0.43 

0.75 

0.69 

KOOlO 

B 

0 

2 

12 

-0.27 

0.11 

0.28 

-0.32 

KOOlO 

C 

0 

1 

6 

-4.40 

0.00 

0.00 

-0.68 

KOOlO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOOll 

* 

-1 

1251 

95 

1.38 

0.04 

0.00 

-0.02 

KOOll 

A 

1 

60 

88 

1.80 

0.17 

0.70 

0.53 

KOOll 

B 

0 

4 

6 

-0.02 

0.24 

0.48 

-0.26 

KOOll 

C 

0 

1 

1 

-1.83 

0.00 

0.07 

-0.27 

KOOll 

D 

0 

3 

4 

-1.10 

0.71 

0.23 

-0.38 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0012 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0012 

A 

1 

15 

83 

1.67 

0.47 

0.47 

0.75 

K0012 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0012 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0012 

D 

0 

3 

17 

-3.48 

1.00 

0.12 

-0.75 

K0013 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0013 

A 

1 

15 

83 

1.75 

0.38 

0.56 

0.76 

K0013 

B 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

K0013 

C 

0 

1 

6 

-1.06 

0.00 

0.25 

-0.22 

K0013 

D 

0 

1 

6 

-2.36 

0.00 

0.07 

-0.36 

K0014 

* 

-1 

1202 

91 

1.38 

0.04 

0.00 

-0.01 

K0014 

A 

1 

91 

78 

1.65 

0.12 

0.97 

0.31 

K0014 

B 

0 

20 

17 

0.87 

0.22 

1.32 

-0.22 

K0014 

C 

0 

5 

4 

0.65 

0.38 

0.78 

-0.15 

K0014 

D 

0 

1 

1 

-0.77 

0.00 

0.15 

-0.18 

K0015 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0015 

A 

1 

16 

89 

2.09 

0.39 

0.87 

0.44 

K0015 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0015 

C 

0 

1 

6 

0.99 

0.00 

1.19 

-0.13 

K0015 

D 

0 

1 

6 

-1.38 

0.00 

0.11 

-0.48 

K0016 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

K0016 

A 

1 

14 

74 

2.13 

0.48 

1.47 

0.26 

K0016 

B 

0 

1 

5 

-0.39 

0.00 

0.20 

-0.33 

K0016 

C 

0 

3 

16 

1.80 

0.41 

2.09 

-0.02 

K0016 

D 

0 

1 

5 

0.82 

0.00 

0.67 

-0.15 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0017 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0017 

A 

1 

17 

94 

1.90 

0.30 

1.13 

-0.15 

K0017 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0017 

C 

0 

1 

6 

2.69 

0.00 

3.81 

0.15 

K0017 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0018 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0018 

A 

1 

13 

76 

2.42 

0.42 

0.77 

0.56 

K0018 

B 

0 

3 

18 

-0.28 

0.52 

0.35 

-0.61 

K0018 

C 

0 

1 

6 

1.65 

0.00 

1.81 

-0.04 

K0018 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0019 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0019 

A 

1 

14 

78 

2.14 

0.43 

0.64 

0.64 

K0019 

B 

0 

1 

6 

0.10 

0.00 

0.64 

-0.17 

K0019 

C 

0 

1 

6 

-0.62 

0.00 

0.31 

-0.26 

K0019 

D 

0 

2 

11 

-1.38 

1.50 

0.34 

-0.52 

K0020 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0020 

A 

1 

10 

59 

2.34 

0.38 

0.65 

0.61 

K0020 

B 

0 

1 

6 

0.72 

0.00 

0.52 

-0.14 

K0020 

C 

0 

4 

24 

1.05 

0.43 

0.94 

-0.19 

K0020 

D 

0 

2 

12 

-0.81 

1.56 

0.28 

-0.57 

K0021 

* 

-1 

815 

62 

1.32 

0.05 

0.00 

-0.05 

K0021 

A 

1 

346 

69 

2.20 

0.08 

0.93 

0.58 

K0021 

B 

0 

48 

10 

0.38 

0.19 

1.10 

-0.20 

K0021 

C 

0 

77 

15 

0.15 

0.12 

0.63 

-0.31 

K0021 

D 

0 

33 

7 

-1.25 

0.33 

0.37 

-0.40 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0022 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0022 

A 

1 

14 

78 

2.04 

0.43 

0.86 

0.42 

K0022 

B 

0 

2 

11 

1.09 

1.55 

2.86 

-0.12 

K0022 

C 

0 

2 

11 

-0.39 

0.58 

0.31 

-0.43 

K0022 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0023 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0023 

A 

1 

9 

50 

2.22 

0.40 

0.69 

0.58 

K0023 

B 

0 

3 

17 

1.84 

0.81 

2.60 

0.15 

K0023 

C 

0 

3 

17 

-0.38 

0.75 

0.30 

-0.50 

K0023 

D 

0 

3 

17 

-0.09 

0.21 

0.25 

-0.42 

K0024 

* 

-1 

1202 

91 

1.40 

0.04 

0.00 

0.05 

K0024 

A 

1 

108 

92 

1.31 

0.11 

0.95 

0.41 

K0024 

B 

0 

3 

3 

-0.11 

0.35 

0.51 

-0.16 

K0024 

C 

0 

6 

5 

-1.03 

0.84 

0.49 

-0.38 

K0024 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0025 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

K0025 

A 

1 

12 

63 

2.45 

0.35 

0.80 

0.59 

K0025 

B 

0 

3 

16 

0.93 

0.91 

1.10 

-0.20 

K0025 

C 

0 

2 

11 

0.31 

0.86 

0.43 

-0.29 

K0025 

D 

0 

2 

11 

-0.26 

2.11 

0.74 

-0.41 

K0026 

* 

-1 

1199 

91 

1.36 

0.04 

0.00 

-0.06 

K0026 

A 

1 

112 

93 

1.77 

0.11 

0.95 

0.32 

K0026 

B 

0 

3 

3 

0.71 

0.17 

0.74 

-0.12 

K0026 

C 

0 

4 

3 

-0.33 

0.81 

0.52 

-0.29 

K0026 

D 

0 

1 

1 

0.29 

0.00 

0.47 

-0.10 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0027 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0027 

A 

1 

17 

94 

2.45 

0.43 

0.63 

0.50 

K0027 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0027 

C 

0 

1 

6 

-1.83 

0.00 

0.10 

-0.50 

K0027 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0028 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0028 

A 

1 

15 

83 

2.54 

0.44 

1.17 

0.49 

K0028 

B 

0 

3 

17 

0.22 

0.50 

0.55 

-0.49 

K0028 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0028 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0029 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0029 

A 

1 

9 

53 

1.92 

0.59 

2.23 

0.27 

K0029 

B 

0 

1 

6 

3.08 

0.00 

4.98 

0.25 

K0029 

C 

0 

1 

6 

1.85 

0.00 

1.46 

0.05 

K0029 

D 

0 

6 

35 

0.63 

0.43 

0.62 

-0.44 

K0030 

* 

-1 

1202 

91 

1.39 

0.04 

0.00 

0.02 

K0030 

A 

1 

38 

32 

2.04 

0.21 

1.11 

0.41 

K0030 

B 

0 

21 

18 

0.62 

0.32 

1.01 

-0.24 

K0030 

C 

0 

56 

48 

1.09 

0.12 

0.96 

-0.13 

K0030 

D 

0 

2 

2 

-1.47 

0.46 

0.06 

-0.28 

K0031 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0031 

A 

1 

9 

50 

3.27 

0.33 

0.43 

0.77 

K0031 

B 

0 

2 

11 

-0.82 

0.20 

0.07 

-0.59 

K0031 

C 

0 

6 

33 

1.09 

0.49 

0.78 

-0.37 

K0031 

D 

0 

1 

6 

1.34 

0.00 

0.60 

-0.09 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0032 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0032 

A 

1 

11 

61 

2.17 

0.67 

1.51 

0.38 

K0032 

B 

0 

1 

6 

0.27 

0.00 

0.65 

-0.15 

K0032 

C 

0 

4 

22 

1.42 

0.83 

5.67 

-0.03 

K0032 

D 

0 

2 

11 

-1.02 

0.05 

0.18 

-0.44 

K0033 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

K0033 

A 

1 

9 

47 

2.64 

0.55 

1.34 

0.56 

K0033 

B 

0 

5 

26 

1.30 

0.67 

1.85 

-0.14 

K0033 

C 

0 

2 

11 

0.72 

0.53 

0.55 

-0.20 

K0033 

D 

0 

3 

16 

0.03 

0.30 

0.26 

-0.43 

K0034 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0034 

A 

1 

14 

82 

1.56 

0.41 

1.02 

0.21 

K0034 

B 

0 

3 

18 

0.73 

0.93 

1.80 

-0.21 

K0034 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0034 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0035 

* 

-1 

1301 

99 

1.40 

0.04 

0.00 

0.08 

K0035 

A 

1 

6 

33 

1.92 

0.32 

0.63 

0.50 

K0035 

B 

0 

3 

17 

-0.02 

0.80 

0.55 

-0.08 

K0035 

C 

0 

5 

28 

1.13 

0.42 

1.27 

0.21 

K0035 

D 

0 

4 

22 

-2.53 

1.34 

0.37 

-0.73 

K0036 

* 

-1 

1197 

91 

1.37 

0.04 

0.00 

-0.02 

K0036 

A 

1 

no 

90 

1.65 

0.10 

0.82 

0.47 

K0036 

B 

0 

4 

3 

0.24 

0.65 

0.80 

-0.19 

K0036 

C 

0 

8 

7 

-0.46 

0.15 

0.26 

-0.43 

K0036 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0037 


-1 

816 

62 

1.32 

0.05 

0.00 

-0.05 

K0037 

A 

1 

385 

77 

2.03 

0.08 

0.99 

0.55 

K0037 

B 

0 

19 

4 

-0.30 

0.18 

0.41 

-0.19 

K0037 

C 

0 

64 

13 

0.10 

0.16 

0.80 

-0.29 

K0037 

D 

0 

35 

7 

-1.06 

0.31 

0.42 

-0.38 

K0038 


-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

K0038 

A 

1 

15 

79 

2.28 

0.42 

1.02 

0.55 

K0038 

B 

0 

2 

11 

1.37 

0.50 

1.48 

-0.04 

K0038 

C 

0 

1 

5 

-0.71 

0.00 

0.16 

-0.25 

K0038 

D 

0 

1 

5 

-5.12 

0.00 

0.00 

-0.71 

K0039 


-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

K0039 

A 

1 

11 

69 

2.16 

0.55 

0.78 

0.52 

K0039 

B 

0 

1 

6 

1.09 

0.00 

1.44 

-0.07 

K0039 

C 

0 

3 

19 

0.00 

0.52 

0.64 

-0.43 

K0039 

D 

0 

1 

6 

-0.06 

0.00 

0.45 

-0.24 

K0040 


-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0040 

A 

1 

13 

72 

1.88 

0.40 

0.71 

0.70 

K0040 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0040 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0040 

D 

0 

5 

28 

-1.48 

0.93 

0.31 

-0.70 

K0041 


-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0041 

A 

1 

13 

72 

1.85 

0.57 

2.05 

0.56 

K0041 

B 

0 

1 

6 

-1.66 

0.00 

0.14 

-0.25 

K0041 

C 

0 

2 

11 

0.77 

0.97 

2.50 

-0.03 

K0041 

D 

0 

2 

11 

-3.26 

2.15 

0.25 

-0.59 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0042 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0042 

A 

1 

15 

83 

1.72 

0.38 

1.39 

0.21 

K0042 

B 

0 

1 

6 

0.74 

0.00 

0.76 

-0.15 

K0042 

C 

0 

2 

11 

1.05 

0.26 

1.07 

-0.14 

K0042 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0043 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0043 

A 

1 

14 

82 

2.61 

0.42 

0.57 

0.69 

K0043 

B 

0 

2 

12 

-0.28 

0.12 

0.41 

-0.41 

K0043 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0043 

D 

0 

1 

6 

-2.37 

0.00 

0.05 

-0.55 

K0044 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0044 

A 

1 

17 

94 

2.07 

0.32 

1.06 

0.18 

K0044 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0044 

C 

0 

1 

6 

1.07 

0.00 

0.77 

-0.18 

K0044 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0045 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.06 

K0045 

A 

1 

9 

53 

1.59 

0.23 

0.50 

0.72 

K0045 

B 

0 

4 

24 

-0.40 

0.80 

0.64 

-0.41 

K0045 

C 

0 

2 

12 

0.07 

0.54 

0.61 

-0.15 

K0045 

D 

0 

2 

12 

-1.03 

1.18 

0.31 

-0.44 

K0046 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0046 

A 

1 

11 

61 

2.79 

0.43 

0.80 

0.62 

K0046 

B 

0 

1 

6 

1.34 

0.00 

0.88 

-0.08 

K0046 

C 

0 

6 

33 

0.44 

0.65 

0.68 

-0.60 

K0046 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0047 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

K0047 

A 

1 

7 

41 

2.45 

0.60 

0.84 

0.57 

K0047 

B 

0 

3 

18 

0.37 

0.65 

0.59 

-0.08 

K0047 

C 

0 

4 

24 

-0.02 

1.76 

2.28 

-0.18 

K0047 

D 

0 

3 

18 

-1.57 

1.18 

0.21 

-0.45 

K0048 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0048 

A 

1 

10 

53 

1.61 

0.38 

1.11 

0.45 

K0048 

B 

0 

1 

5 

1.85 

0.00 

2.13 

0.15 

K0048 

C 

0 

6 

32 

0.77 

0.22 

0.80 

-0.23 

K0048 

D 

0 

2 

11 

-0.48 

0.27 

0.21 

-0.50 

K0049 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

0.01 

K0049 

A 

1 

13 

81 

1.52 

0.50 

1.14 

0.29 

K0049 

B 

0 

2 

13 

-0.10 

0.97 

0.82 

-0.31 

K0049 

C 

0 

1 

6 

0.93 

0.00 

1.54 

-0.05 

K0049 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0050 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0050 

A 

1 

17 

94 

2.18 

0.41 

0.73 

0.48 

K0050 

B 

0 

1 

6 

-1.62 

0.00 

0.12 

-0.48 

K0050 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0050 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0051 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0051 

A 

-1 

18 

100 

2.17 

0.39 

0.00 

0.00 

K0051 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0051 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0051 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


235 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0052 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0052 

A 

1 

15 

88 

1.55 

0.52 

1.33 

0.32 

K0052 

B 

0 

1 

6 

-0.40 

0.00 

0.58 

-0.22 

K0052 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0052 

D 

0 

1 

6 

-0.29 

0.00 

0.65 

-0.21 

K0053 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

K0053 

A 

1 

14 

78 

1.41 

0.41 

1.30 

0.55 

K0053 

B 

0 

1 

6 

-5.01 

0.00 

0.00 

-0.62 

K0053 

C 

0 

1 

6 

2.89 

0.00 

15.08 

0.23 

K0053 

D 

0 

2 

11 

-2.16 

0.78 

0.13 

-0.45 

K0054 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0054 

A 

1 

16 

89 

1.49 

0.35 

1.11 

0.01 

K0054 

B 

0 

1 

6 

2.41 

0.00 

4.69 

0.17 

K0054 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0054 

D 

0 

1 

6 

0.47 

0.00 

0.67 

-0.19 

K0055 

* 

-1 

816 

62 

1.32 

0.05 

0.00 

-0.05 

K0055 

A 

1 

404 

80 

1.89 

0.08 

1.07 

0.45 

K0055 

B 

0 

47 

9 

0.67 

0.17 

1.65 

-0.14 

K0055 

C 

0 

26 

5 

-0.36 

0.32 

0.72 

-0.24 

K0055 

D 

0 

26 

5 

-1.46 

0.38 

0.50 

-0.38 

K0056 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0056 

A 

1 

15 

88 

2.04 

0.40 

0.99 

0.32 

K0056 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0056 

C 

0 

2 

12 

0.56 

0.97 

0.89 

-0.32 

K0056 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0057 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0057 

A 

1 

13 

72 

2.14 

0.34 

0.69 

0.60 

K0057 

B 

0 

2 

11 

0.80 

0.53 

0.77 

-0.20 

K0057 

C 

0 

3 

17 

-0.15 

0.71 

0.44 

-0.55 

K0057 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0058 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0058 

A 

1 

13 

72 

2.36 

0.49 

1.79 

0.60 

K0058 

B 

0 

1 

6 

1.95 

0.00 

2.35 

0.05 

K0058 

C 

0 

3 

17 

-0.24 

0.25 

0.28 

-0.33 

K0058 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.67 

K0059 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0059 

A 

1 

13 

72 

2.57 

0.45 

0.71 

0.63 

K0059 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0059 

C 

0 

3 

17 

0.64 

0.92 

1.46 

-0.25 

K0059 

D 

0 

2 

11 

-1.68 

0.56 

0.08 

-0.60 

K0060 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0060 

A 

1 

7 

39 

2.78 

0.57 

0.72 

0.74 

K0060 

B 

0 

8 

44 

0.52 

0.26 

0.61 

-0.49 

K0060 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0060 

D 

0 

3 

17 

0.26 

0.52 

0.44 

-0.32 

K0061 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0061 

A 

1 

13 

72 

2.50 

0.43 

0.69 

0.64 

K0061 

B 

0 

2 

11 

0.75 

0.24 

0.78 

-0.22 

K0061 

C 

0 

2 

11 

-0.60 

0.54 

0.23 

-0.50 

K0061 

D 

0 

1 

6 

-0.06 

0.00 

0.34 

-0.27 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0062 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0062 

A 

1 

13 

68 

2.31 

0.43 

0.61 

0.67 

K0062 

B 

0 

5 

26 

-0.10 

0.39 

0.62 

-0.53 

K0062 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0062 

D 

0 

1 

5 

-1.12 

0.00 

0.16 

-0.35 

K0063 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0063 

A 

1 

17 

94 

1.41 

0.38 

1.02 

0.24 

K0063 

B 

0 

1 

6 

-0.15 

0.00 

0.50 

-0.24 

K0063 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0063 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0064 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0064 

A 

1 

7 

41 

3.45 

0.58 

0.39 

0.83 

K0064 

B 

0 

4 

24 

-0.20 

0.38 

0.34 

-0.50 

K0064 

C 

0 

5 

29 

0.49 

0.41 

0.76 

-0.35 

K0064 

D 

0 

1 

6 

0.36 

0.00 

0.49 

-0.15 

K0065 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.04 

K0065 

A 

1 

10 

53 

2.87 

0.42 

0.86 

0.62 

K0065 

B 

0 

5 

26 

1.15 

0.31 

0.67 

-0.29 

K0065 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0065 

D 

0 

4 

21 

0.56 

0.94 

1.08 

-0.45 

K0066 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0066 

A 

1 

11 

61 

3.23 

0.33 

0.44 

0.76 

K0066 

B 

0 

2 

11 

0.52 

0.27 

0.29 

-0.31 

K0066 

C 

0 

3 

17 

1.55 

0.60 

1.14 

-0.14 

K0066 

D 

0 

2 

11 

-1.53 

0.39 

0.04 

-0.70 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0067 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.06 

K0067 

A 

1 

9 

47 

1.73 

0.50 

1.21 

0.51 

K0067 

B 

0 

4 

21 

-1.11 

1.36 

0.64 

-0.40 

K0067 

C 

0 

3 

16 

1.77 

0.17 

2.24 

0.24 

K0067 

D 

0 

3 

16 

-1.83 

0.75 

0.10 

-0.48 

K0068 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

K0068 

A 

1 

4 

22 

2.35 

0.79 

1.38 

0.40 

K0068 

B 

0 

6 

33 

1.46 

0.61 

2.39 

0.23 

K0068 

C 

0 

7 

39 

-0.89 

0.78 

0.23 

-0.64 

K0068 

D 

0 

1 

6 

2.17 

0.00 

1.68 

0.16 

K0069 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0069 

A 

1 

11 

61 

2.75 

0.46 

0.88 

0.66 

K0069 

B 

0 

3 

17 

0.39 

1.09 

0.90 

-0.21 

K0069 

C 

0 

3 

17 

-1.76 

1.66 

0.27 

-0.62 

K0069 

D 

0 

1 

6 

1.01 

0.00 

0.71 

-0.05 

K0070 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0070 

A 

1 

16 

89 

2.18 

0.41 

1.61 

0.34 

K0070 

B 

0 

1 

6 

0.74 

0.00 

0.76 

-0.19 

K0070 

C 

0 

1 

6 

0.17 

0.00 

0.43 

-0.27 

K0070 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0071 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.03 

K0071 

A 

1 

16 

80 

2.28 

0.36 

0.59 

0.66 

K0071 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0071 

C 

0 

2 

10 

-0.17 

0.30 

0.34 

-0.38 

K0071 

D 

0 

2 

10 

-0.74 

0.23 

0.19 

-0.50 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0072 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0072 

A 

1 

14 

78 

2.24 

0.32 

0.52 

0.74 

K0072 

B 

0 

2 

11 

-0.48 

0.64 

0.29 

-0.48 

K0072 

C 

0 

2 

11 

-0.56 

0.08 

0.22 

-0.50 

K0072 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0073 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0073 

A 

1 

14 

78 

2.29 

0.33 

0.88 

0.56 

K0073 

B 

0 

1 

6 

0.72 

0.00 

0.50 

-0.23 

K0073 

C 

0 

3 

17 

0.50 

0.23 

0.42 

-0.49 

K0073 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0074 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0074 

A 

1 

13 

68 

2.55 

0.48 

0.78 

0.64 

K0074 

B 

0 

1 

5 

1.27 

0.00 

1.40 

-0.02 

K0074 

C 

0 

4 

21 

-0.32 

0.91 

0.60 

-0.37 

K0074 

D 

0 

1 

5 

-5.12 

0.00 

0.00 

-0.63 

K0075 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0075 

A 

1 

14 

78 

1.73 

0.30 

1.02 

0.50 

K0075 

B 

0 

2 

11 

-1.52 

3.60 

2.37 

-0.51 

K0075 

C 

0 

2 

11 

0.41 

0.87 

0.62 

-0.15 

K0075 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0076 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0076 

A 

1 

11 

58 

2.06 

0.49 

1.17 

0.60 

K0076 

B 

0 

5 

26 

0.48 

0.45 

1.10 

-0.19 

K0076 

C 

0 

1 

5 

0.68 

0.00 

0.91 

-0.05 

K0076 

D 

0 

2 

11 

-2.62 

0.25 

0.03 

-0.66 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0077 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.01 

K0077 

A 

1 

12 

60 

2.22 

0.42 

0.81 

0.60 

K0077 

B 

0 

2 

10 

0.55 

0.70 

0.77 

-0.19 

K0077 

C 

0 

5 

25 

0.48 

0.50 

0.92 

-0.36 

K0077 

D 

0 

1 

5 

-1.08 

0.00 

0.12 

-0.37 

K0078 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.07 

K0078 

A 

1 

14 

78 

2.65 

0.37 

0.97 

0.46 

K0078 

B 

0 

2 

11 

1.34 

0.24 

0.71 

-0.26 

K0078 

C 

0 

2 

11 

1.02 

0.13 

0.51 

-0.35 

K0078 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0079 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

K0079 

A 

1 

14 

82 

2.34 

0.40 

0.66 

0.63 

K0079 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0079 

C 

0 

3 

18 

-0.57 

0.65 

0.36 

-0.63 

K0079 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0080 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

K0080 

A 

1 

15 

88 

2.34 

0.41 

0.71 

0.52 

K0080 

B 

0 

1 

6 

-1.06 

0.00 

0.13 

-0.46 

K0080 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0080 

D 

0 

1 

6 

0.25 

0.00 

0.49 

-0.26 

K0081 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0081 

A 

1 

7 

39 

3.53 

0.51 

0.58 

0.67 

K0081 

B 

0 

10 

56 

1.15 

0.47 

0.92 

-0.53 

K0081 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0081 

D 

0 

1 

6 

-0.21 

0.00 

0.11 

-0.30 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0082 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0082 

A 

1 

16 

89 

2.30 

0.41 

0.80 

0.51 

K0082 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0082 

C 

0 

2 

11 

-0.51 

0.19 

0.25 

-0.51 

K0082 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0083 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0083 

A 

1 

14 

78 

2.06 

0.49 

1.02 

0.61 

K0083 

B 

0 

1 

6 

-0.15 

0.00 

0.49 

-0.16 

K0083 

C 

0 

1 

6 

-0.76 

0.00 

0.26 

-0.22 

K0083 

D 

0 

2 

11 

-2.07 

2.33 

0.73 

-0.53 

K0084 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

K0084 

A 

1 

13 

76 

1.74 

0.39 

0.72 

0.69 

K0084 

B 

0 

1 

6 

0.19 

0.00 

0.67 

-0.08 

K0084 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0084 

D 

0 

3 

18 

-2.52 

1.52 

0.38 

-0.72 

K0085 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

K0085 

A 

1 

14 

82 

2.00 

0.44 

0.78 

0.46 

K0085 

B 

0 

1 

6 

0.82 

0.00 

1.03 

-0.12 

K0085 

C 

0 

2 

12 

-0.43 

0.47 

0.33 

-0.46 

K0085 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0086 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

K0086 

A 

1 

16 

84 

2.05 

0.45 

0.94 

0.28 

K0086 

B 

0 

1 

5 

-1.03 

0.00 

0.16 

-0.38 

K0086 

C 

0 

2 

11 

1.52 

1.20 

3.65 

-0.06 

K0086 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


242 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0087 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0087 

A 

1 

17 

94 

2.14 

0.36 

1.03 

0.32 

K0087 

B 

0 

1 

6 

0.06 

0.00 

0.37 

-0.32 

K0087 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0087 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0088 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0088 

A 

1 

16 

89 

1.91 

0.47 

0.89 

0.41 

K0088 

B 

0 

2 

11 

-0.58 

0.18 

0.37 

-0.41 

K0088 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0088 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0089 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.07 

K0089 

A 

1 

17 

94 

2.44 

0.36 

0.88 

0.34 

K0089 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0089 

C 

0 

1 

6 

0.25 

0.00 

0.33 

-0.34 

K0089 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0090 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.07 

K0090 

A 

1 

17 

94 

2.36 

0.43 

1.05 

0.23 

K0090 

B 

0 

1 

6 

0.61 

0.00 

0.60 

-0.23 

K0090 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0090 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0091 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0091 

A 

1 

16 

89 

2.47 

0.48 

0.65 

0.43 

K0091 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0091 

C 

0 

1 

6 

2.00 

0.00 

4.45 

-0.01 

K0091 

D 

0 

1 

6 

-3.08 

0.00 

0.03 

-0.58 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0092 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0092 

A 

1 

15 

83 

1.60 

0.36 

1.04 

0.29 

K0092 

B 

0 

2 

11 

0.39 

1.06 

1.01 

-0.28 

K0092 

C 

0 

1 

6 

0.95 

0.00 

1.08 

-0.09 

K0092 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0093 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0093 

A 

1 

14 

78 

1.84 

0.41 

0.56 

0.68 

K0093 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0093 

C 

0 

1 

6 

-1.62 

0.00 

0.14 

-0.35 

K0093 

D 

0 

3 

17 

-1.17 

0.80 

0.39 

-0.54 

K0094 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0094 

A 

1 

17 

94 

1.96 

0.49 

1.09 

0.16 

K0094 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0094 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0094 

D 

0 

1 

6 

0.64 

0.00 

1.11 

-0.16 

K0095 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0095 

A 

1 

16 

84 

1.63 

0.42 

0.93 

0.39 

K0095 

B 

0 

2 

11 

-0.36 

0.16 

0.44 

-0.36 

K0095 

C 

0 

1 

5 

0.39 

0.00 

0.91 

-0.14 

K0095 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0096 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.01 

K0096 

A 

1 

14 

88 

1.85 

0.39 

0.82 

0.48 

K0096 

B 

0 

1 

6 

0.06 

0.00 

0.46 

-0.26 

K0096 

C 

0 

1 

6 

-0.73 

0.00 

0.21 

-0.40 

K0096 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0097 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0097 

A 

1 

15 

83 

1.91 

0.36 

0.71 

0.58 

K0097 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0097 

C 

0 

1 

6 

0.33 

0.00 

0.68 

-0.14 

K0097 

D 

0 

2 

11 

-1.73 

2.41 

0.49 

-0.59 

K0098 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0098 

A 

1 

13 

72 

1.73 

0.38 

1.19 

0.37 

K0098 

B 

0 

1 

6 

0.79 

0.00 

0.85 

-0.08 

K0098 

C 

0 

2 

11 

2.41 

1.12 

7.23 

0.22 

K0098 

D 

0 

2 

11 

-1.88 

0.22 

0.06 

-0.69 

K0099 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0099 

A 

1 

16 

84 

1.91 

0.43 

0.53 

0.59 

K0099 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0099 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0099 

D 

0 

3 

16 

-1.58 

1.58 

1.04 

-0.59 

KOI 00 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

KOI 00 

A 

1 

13 

68 

1.47 

0.47 

1.06 

0.37 

KOI 00 

B 

0 

4 

21 

0.73 

0.68 

2.46 

-0.11 

KOI 00 

C 

0 

2 

11 

-0.91 

0.11 

0.25 

-0.41 

KOI 00 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOlOl 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

KOlOl 

A 

1 

10 

59 

2.14 

0.48 

0.63 

0.68 

KOlOl 

B 

0 

1 

6 

-1.12 

0.00 

0.17 

-0.21 

KOlOl 

C 

0 

5 

29 

-0.21 

0.59 

0.73 

-0.28 

KOlOl 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.67 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 02 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 02 

A 

1 

12 

67 

2.43 

0.51 

0.92 

0.61 

KOI 02 

B 

0 

1 

6 

0.37 

0.00 

0.69 

-0.14 

KOI 02 

C 

0 

4 

22 

0.15 

0.80 

1.64 

-0.37 

KOI 02 

D 

0 

1 

6 

-2.24 

0.00 

0.05 

-0.45 

KOI 03 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 03 

A 

1 

15 

94 

2.24 

0.40 

0.22 

0.73 

KOI 03 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 03 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 03 

D 

0 

1 

6 

-4.14 

0.00 

0.02 

-0.73 

KOI 04 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

KOI 04 

A 

1 

11 

61 

2.52 

0.44 

0.59 

0.68 

KOI 04 

B 

0 

1 

6 

-5.01 

0.00 

0.00 

-0.53 

KOI 04 

C 

0 

3 

17 

0.84 

1.49 

5.70 

-0.03 

KOI 04 

D 

0 

3 

17 

-2.26 

1.10 

0.13 

-0.54 

KOI 05 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 05 

A 

1 

15 

88 

2.03 

0.35 

0.72 

0.56 

KOI 05 

B 

0 

1 

6 

-0.04 

0.00 

0.37 

-0.29 

KOI 05 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 05 

D 

0 

1 

6 

-1.08 

0.00 

0.13 

-0.47 

KOI 06 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 06 

A 

1 

16 

94 

1.88 

0.41 

0.97 

0.29 

KOI 06 

B 

0 

1 

6 

-0.15 

0.00 

0.40 

-0.29 

KOI 06 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 06 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 07 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

KOI 07 

A 

1 

13 

72 

1.70 

0.47 

0.88 

0.57 

KOI 07 

B 

0 

2 

11 

-0.70 

0.38 

0.36 

-0.37 

KOI 07 

C 

0 

2 

11 

-0.26 

0.35 

0.55 

-0.28 

KOI 07 

D 

0 

1 

6 

-0.39 

0.00 

0.46 

-0.21 

KOI 08 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

KOI 08 

A 

1 

15 

83 

1.40 

0.36 

1.13 

0.27 

KOI 08 

B 

0 

1 

6 

1.18 

0.00 

1.56 

-0.01 

KOI 08 

C 

0 

1 

6 

-0.31 

0.00 

0.35 

-0.29 

KOI 08 

D 

0 

1 

6 

0.54 

0.00 

0.82 

-0.13 

KOI 09 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 09 

A 

1 

14 

78 

2.31 

0.49 

0.93 

0.59 

KOI 09 

B 

0 

1 

6 

-0.69 

0.00 

0.20 

-0.23 

KOI 09 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 09 

D 

0 

3 

17 

-1.26 

1.93 

0.79 

-0.52 

KOllO 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

KOllO 

A 

1 

12 

67 

2.52 

0.39 

0.66 

0.64 

KOllO 

B 

0 

2 

11 

1.71 

0.27 

1.64 

0.00 

KOllO 

C 

0 

3 

17 

-0.06 

0.41 

0.32 

-0.46 

KOllO 

D 

0 

1 

6 

-2.36 

0.00 

0.03 

-0.57 

KOI 11 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 11 

A 

1 

14 

82 

1.97 

0.44 

1.04 

0.30 

KOI 11 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 11 

C 

0 

2 

12 

0.43 

0.91 

0.81 

-0.31 

KOI 11 

D 

0 

1 

6 

1.32 

0.00 

1.36 

-0.07 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 12 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.04 

KOI 12 

A 

1 

9 

47 

2.06 

0.53 

0.79 

0.54 

KOI 12 

B 

0 

6 

32 

0.34 

0.40 

0.83 

-0.20 

KOI 12 

C 

0 

3 

16 

-1.14 

1.96 

0.84 

-0.45 

KOI 12 

D 

0 

1 

5 

0.65 

0.00 

0.70 

-0.03 

K0113 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

0.00 

K0113 

A 

1 

15 

75 

2.12 

0.42 

0.71 

0.58 

K0113 

B 

0 

1 

5 

0.54 

0.00 

0.84 

-0.10 

K0113 

C 

0 

1 

5 

1.41 

0.00 

2.02 

0.00 

K0113 

D 

0 

3 

15 

-1.77 

1.23 

0.21 

-0.65 

KOI 14 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 14 

A 

1 

14 

78 

2.14 

0.51 

1.09 

0.42 

KOI 14 

B 

0 

3 

17 

0.58 

0.26 

0.82 

-0.29 

KOI 14 

C 

0 

1 

6 

-0.51 

0.00 

0.26 

-0.30 

KOI 14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0115 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0115 

A 

1 

17 

94 

1.62 

0.31 

0.82 

0.42 

K0115 

B 

0 

1 

6 

-0.76 

0.00 

0.20 

-0.42 

KOI 15 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0116 

* 

-1 

1203 

91 

1.38 

0.04 

0.00 

0.00 

K0116 

A 

1 

81 

70 

1.69 

0.15 

1.01 

0.38 

K0116 

B 

0 

19 

16 

0.74 

0.17 

1.02 

-0.21 

KOI 16 

C 

0 

16 

14 

0.44 

0.24 

0.81 

-0.28 

K0116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0117 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0117 

A 

1 

15 

83 

1.15 

0.23 

0.89 

0.44 

K0117 

B 

0 

2 

11 

-0.40 

1.26 

0.67 

-0.47 

K0117 

C 

0 

1 

6 

0.65 

0.00 

1.00 

-0.07 

K0117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 18 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

KOI 18 

A 

1 

15 

83 

1.80 

0.36 

0.63 

0.68 

K0118 

B 

0 

1 

6 

-5.01 

0.00 

0.00 

-0.67 

KOI 18 

C 

0 

1 

6 

1.25 

0.00 

1.97 

0.01 

KOI 18 

D 

0 

1 

6 

-2.94 

0.00 

0.03 

-0.44 

K0119 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.04 

K0119 

A 

1 

14 

70 

2.80 

0.48 

0.70 

0.62 

K0119 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0119 

C 

0 

2 

10 

1.78 

1.62 

7.57 

-0.01 

K0119 

D 

0 

4 

20 

-1.31 

0.55 

0.20 

-0.70 

KOI 20 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

KOI 20 

A 

1 

15 

88 

1.99 

0.36 

0.97 

0.28 

KOI 20 

B 

0 

1 

6 

0.17 

0.00 

0.36 

-0.31 

KOI 20 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 20 

D 

0 

1 

6 

1.45 

0.00 

1.28 

-0.08 

K0121 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

K0121 

A 

1 

15 

79 

2.27 

0.41 

0.80 

0.61 

K0121 

B 

0 

1 

5 

-0.11 

0.00 

0.40 

-0.24 

K0121 

C 

0 

2 

11 

-0.11 

0.65 

0.49 

-0.35 

K0121 

D 

0 

1 

5 

-1.12 

0.00 

0.15 

-0.38 



easyCBM CCSS Kindergarten Math Measure Development 


249 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 22 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.02 

KOI 22 

A 

1 

10 

63 

1.54 

0.66 

2.06 

0.32 

KOI 22 

B 

0 

3 

19 

-0.17 

0.87 

0.83 

-0.34 

KOI 22 

C 

0 

1 

6 

0.84 

0.00 

1.19 

-0.04 

KOI 22 

D 

0 

2 

13 

0.94 

0.37 

1.40 

-0.03 

KOI 23 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

KOI 23 

A 

1 

13 

72 

2.59 

0.52 

0.83 

0.53 

KOI 23 

B 

0 

3 

17 

0.56 

0.65 

1.02 

-0.35 

KOI 23 

C 

0 

1 

6 

0.26 

0.00 

0.50 

-0.23 

KOI 23 

D 

0 

1 

6 

0.16 

0.00 

0.45 

-0.24 

KOI 24 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

KOI 24 

A 

1 

15 

83 

2.55 

0.38 

0.98 

0.61 

KOI 24 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 24 

C 

0 

1 

6 

1.93 

0.00 

1.64 

0.00 

KOI 24 

D 

0 

2 

11 

-2.74 

2.68 

0.23 

-0.72 

KOI 25 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

KOI 25 

A 

1 

16 

89 

1.62 

0.41 

0.91 

0.40 

KOI 25 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 25 

C 

0 

2 

11 

-0.48 

0.58 

0.44 

-0.40 

KOI 25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 26 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 26 

A 

1 

16 

84 

1.86 

0.40 

0.87 

0.36 

KOI 26 

B 

0 

2 

11 

0.35 

1.23 

1.11 

-0.27 

KOI 26 

C 

0 

1 

5 

0.17 

0.00 

0.50 

-0.21 

KOI 26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 27 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

KOI 27 

A 

1 

14 

78 

1.74 

0.25 

0.75 

0.69 

KOI 27 

B 

0 

1 

6 

0.72 

0.00 

0.66 

-0.05 

KOI 27 

C 

0 

2 

11 

-0.30 

0.10 

0.24 

-0.27 

KOI 27 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.82 

K0128 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.05 

K0128 

A 

1 

9 

60 

1.79 

0.51 

0.71 

0.60 

K0128 

B 

0 

2 

13 

-2.28 

2.73 

0.75 

-0.47 

K0128 

C 

0 

3 

20 

0.57 

0.60 

1.25 

-0.01 

K0128 

D 

0 

1 

7 

-4.14 

0.00 

0.01 

-0.52 

KOI 29 

* 

-1 

1202 

91 

1.38 

0.04 

0.00 

-0.01 

KOI 29 

A 

1 

105 

90 

1.56 

0.11 

0.94 

0.32 

KOI 29 

B 

0 

7 

6 

0.46 

0.35 

0.85 

-0.21 

KOI 29 

C 

0 

4 

3 

0.14 

0.29 

0.47 

-0.21 

KOI 29 

D 

0 

1 

1 

0.25 

0.00 

0.48 

-0.09 

K0130 

* 

-1 

1199 

91 

1.41 

0.04 

0.00 

0.06 

K0130 

A 

1 

87 

73 

1.29 

0.17 

1.59 

0.24 

K0130 

B 

0 

22 

18 

0.53 

0.14 

1.04 

-0.18 

K0130 

C 

0 

11 

9 

0.48 

0.32 

1.26 

-0.13 

K0130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0131 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0131 

A 

1 

11 

61 

1.95 

0.51 

0.96 

0.65 

K0131 

B 

0 

5 

28 

-0.13 

0.25 

0.53 

-0.27 

K0131 

C 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

K0131 

D 

0 

1 

6 

-0.97 

0.00 

0.20 

-0.20 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 32 

* 

-1 

1201 

91 

1.38 

0.04 

0.00 

0.00 

KOI 32 

A 

1 

76 

64 

1.94 

0.13 

1.02 

0.54 

KOI 32 

B 

0 

32 

27 

0.46 

0.20 

0.72 

-0.39 

KOI 32 

C 

0 

8 

7 

0.58 

0.31 

0.69 

-0.15 

KOI 32 

D 

0 

2 

2 

-2.70 

1.69 

0.11 

-0.38 

K0133 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0133 

A 

1 

14 

78 

2.07 

0.42 

0.61 

0.54 

K0133 

B 

0 

2 

11 

-0.74 

0.27 

0.27 

-0.40 

K0133 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0133 

D 

0 

2 

11 

-0.25 

2.83 

3.60 

-0.31 

KOI 34 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 34 

A 

1 

13 

72 

2.04 

0.29 

0.67 

0.58 

KOI 34 

B 

0 

1 

6 

-0.79 

0.00 

0.13 

-0.44 

KOI 34 

C 

0 

2 

11 

1.77 

0.00 

1.72 

0.05 

KOI 34 

D 

0 

2 

11 

-0.45 

0.56 

0.22 

-0.55 

K0135 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0135 

A 

1 

11 

61 

2.74 

0.35 

0.54 

0.68 

K0135 

B 

0 

2 

11 

0.60 

0.78 

0.51 

-0.16 

K0135 

C 

0 

3 

17 

0.18 

1.23 

0.97 

-0.29 

K0135 

D 

0 

2 

11 

-1.70 

2.70 

0.58 

-0.54 

K0136 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0136 

A 

1 

13 

72 

2.19 

0.45 

0.99 

0.50 

K0136 

B 

0 

3 

17 

0.08 

0.16 

0.38 

-0.46 

K0136 

C 

0 

2 

11 

0.98 

0.26 

0.94 

-0.16 

K0136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0137 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0137 

A 

-1 

18 

100 

1.47 

0.32 

0.00 

0.00 

K0137 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0137 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0137 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0138 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.07 

K0138 

A 

-1 

18 

100 

2.23 

0.39 

0.00 

0.00 

K0138 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0138 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0138 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0139 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0139 

A 

-1 

18 

100 

1.75 

0.46 

0.00 

0.00 

K0139 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0139 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0139 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 40 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

KOI 40 

A 

1 

16 

84 

1.44 

0.38 

0.66 

0.60 

KOI 40 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 40 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 40 

D 

0 

3 

16 

-1.35 

0.29 

0.24 

-0.60 

K0141 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0141 

A 

1 

17 

94 

1.38 

0.34 

1.16 

-0.11 

K0141 

B 

0 

1 

6 

2.00 

0.00 

4.04 

0.11 

K0141 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 42 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

KOI 42 

A 

-1 

17 

100 

2.02 

0.40 

0.00 

0.00 

KOI 42 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 42 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 42 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 43 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

KOI 43 

A 

1 

16 

89 

1.60 

0.42 

0.91 

0.67 

KOI 43 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 43 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 43 

D 

0 

2 

11 

-3.27 

2.14 

0.25 

-0.67 

KOI 44 

* 

-1 

1301 

99 

1.40 

0.04 

0.00 

0.08 

KOI 44 

A 

1 

14 

78 

1.18 

0.42 

0.98 

0.69 

KOI 44 

B 

0 

1 

6 

0.27 

0.00 

1.11 

0.00 

KOI 44 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 44 

D 

0 

3 

17 

-3.70 

1.24 

0.23 

-0.76 

KOI 45 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

KOI 45 

A 

1 

13 

72 

1.62 

0.28 

1.00 

0.28 

KOI 45 

B 

0 

2 

11 

1.51 

0.26 

1.40 

0.03 

KOI 45 

C 

0 

2 

11 

-0.39 

0.70 

0.25 

-0.59 

KOI 45 

D 

0 

1 

6 

2.38 

0.00 

3.20 

0.21 

KOI 46 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 46 

A 

1 

13 

72 

2.63 

0.55 

0.77 

0.63 

KOI 46 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 46 

C 

0 

4 

22 

-0.47 

0.74 

0.79 

-0.53 

KOI 46 

D 

0 

1 

6 

-0.70 

0.00 

0.35 

-0.27 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 47 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 47 

A 

1 

16 

89 

2.03 

0.38 

0.88 

0.42 

KOI 47 

B 

0 

1 

6 

-0.56 

0.00 

0.24 

-0.37 

KOI 47 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 47 

D 

0 

1 

6 

0.51 

0.00 

0.70 

-0.20 

KOI 48 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

KOI 48 

A 

1 

18 

95 

2.24 

0.43 

0.77 

0.40 

KOI 48 

B 

0 

1 

5 

-1.12 

0.00 

0.17 

-0.40 

KOI 48 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 49 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

KOI 49 

A 

1 

16 

89 

1.84 

0.41 

0.90 

0.68 

KOI 49 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 49 

C 

0 

2 

11 

-3.03 

2.01 

0.21 

-0.68 

KOI 49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0150 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.06 

K0150 

A 

1 

15 

83 

1.03 

0.35 

0.68 

0.58 

K0150 

B 

0 

2 

11 

-0.38 

0.58 

0.84 

-0.20 

K0150 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0150 

D 

0 

1 

6 

-4.14 

0.00 

0.02 

-0.67 

K0151 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0151 

A 

1 

16 

89 

1.85 

0.43 

0.73 

0.54 

K0151 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0151 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0151 

D 

0 

2 

11 

-1.32 

0.31 

0.21 

-0.54 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 52 

* 

-1 

1203 

91 

1.37 

0.04 

0.00 

-0.03 

KOI 52 

A 

1 

108 

93 

1.63 

0.13 

0.94 

0.34 

KOI 52 

B 

0 

5 

4 

-0.35 

0.25 

0.33 

-0.29 

KOI 52 

C 

0 

3 

3 

0.14 

0.09 

0.48 

-0.17 

KOI 52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0153 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0153 

A 

1 

14 

78 

1.62 

0.35 

1.09 

0.58 

K0153 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0153 

C 

0 

2 

11 

0.33 

0.73 

0.72 

-0.13 

K0153 

D 

0 

2 

11 

-2.51 

2.61 

0.45 

-0.64 

KOI 54 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

KOI 54 

A 

1 

15 

83 

1.45 

0.39 

0.67 

0.72 

KOI 54 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 54 

C 

0 

2 

11 

-3.65 

1.40 

0.10 

-0.71 

KOI 54 

D 

0 

1 

6 

-0.96 

0.00 

0.35 

-0.19 

K0155 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.07 

K0155 

A 

1 

15 

88 

2.58 

0.43 

0.70 

0.48 

K0155 

B 

0 

2 

12 

-0.14 

1.52 

0.76 

-0.48 

K0155 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0156 

* 

-1 

1202 

91 

1.39 

0.04 

0.00 

0.02 

K0156 

A 

1 

102 

87 

1.45 

0.12 

0.93 

0.35 

K0156 

B 

0 

10 

9 

0.26 

0.32 

1.00 

-0.25 

K0156 

C 

0 

5 

4 

-0.11 

0.40 

0.60 

-0.24 

K0156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0157 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

K0157 

A 

1 

16 

84 

1.48 

0.32 

1.04 

0.55 

K0157 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0157 

C 

0 

1 

5 

-0.55 

0.00 

0.25 

-0.20 

K0157 

D 

0 

2 

11 

-1.67 

3.25 

2.06 

-0.50 

K0158 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0158 

A 

1 

16 

94 

1.96 

0.37 

1.05 

0.19 

K0158 

B 

0 

1 

6 

0.80 

0.00 

0.75 

-0.19 

K0158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0159 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

KOI 59 

A 

1 

17 

94 

1.49 

0.38 

0.49 

0.58 

KOI 59 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0159 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 59 

D 

0 

1 

6 

-3.08 

0.00 

0.06 

-0.58 

KOI 60 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.04 

KOI 60 

A 

1 

15 

79 

1.29 

0.50 

1.46 

0.46 

KOI 60 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 60 

C 

0 

3 

16 

-0.49 

0.43 

0.83 

-0.30 

KOI 60 

D 

0 

1 

5 

-2.09 

0.00 

0.14 

-0.36 

K0161 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0161 

A 

1 

16 

89 

2.48 

0.40 

0.68 

0.50 

K0161 

B 

0 

1 

6 

-1.83 

0.00 

0.07 

-0.55 

K0161 

C 

0 

1 

6 

1.16 

0.00 

1.32 

-0.14 

K0161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 62 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

KOI 62 

A 

1 

17 

94 

2.34 

0.39 

0.64 

0.49 

KOI 62 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 62 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 62 

D 

0 

1 

6 

-1.38 

0.00 

0.11 

-0.49 

KOI 63 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

KOI 63 

A 

1 

15 

83 

2.56 

0.42 

1.03 

0.50 

KOI 63 

B 

0 

3 

17 

0.25 

0.78 

0.63 

-0.50 

KOI 63 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 64 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 64 

A 

1 

17 

94 

1.77 

0.40 

0.98 

0.26 

KOI 64 

B 

0 

1 

6 

-0.03 

0.00 

0.50 

-0.26 

KOI 64 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 65 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 65 

A 

1 

14 

82 

2.34 

0.50 

1.34 

0.59 

KOI 65 

B 

0 

1 

6 

0.64 

0.00 

0.84 

-0.11 

KOI 65 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 65 

D 

0 

2 

12 

-2.39 

2.53 

0.51 

-0.62 

KOI 66 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

KOI 66 

A 

1 

16 

84 

1.60 

0.40 

0.73 

0.55 

KOI 66 

B 

0 

2 

11 

-0.22 

0.49 

0.66 

-0.26 

KOI 66 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 66 

D 

0 

1 

5 

-2.94 

0.00 

0.04 

-0.53 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 67 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

KOI 67 

A 

1 

13 

72 

2.10 

0.41 

0.66 

0.70 

KOI 67 

B 

0 

1 

6 

0.75 

0.00 

1.01 

-0.04 

KOI 67 

C 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

KOI 67 

D 

0 

3 

17 

-1.00 

0.82 

0.32 

-0.41 

KOI 68 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 68 

A 

1 

13 

72 

2.36 

0.33 

0.64 

0.71 

KOI 68 

B 

0 

2 

11 

0.80 

0.62 

0.80 

-0.21 

KOI 68 

C 

0 

3 

17 

-0.64 

0.36 

0.18 

-0.68 

KOI 68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 69 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 69 

A 

1 

14 

74 

2.41 

0.39 

0.74 

0.67 

KOI 69 

B 

0 

2 

11 

0.85 

0.31 

0.89 

-0.15 

KOI 69 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 69 

D 

0 

3 

16 

-1.34 

0.87 

0.17 

-0.68 

KOI 70 

* 

-1 

1203 

91 

1.39 

0.04 

0.00 

0.01 

KOI 70 

A 

1 

108 

93 

1.44 

0.12 

0.95 

0.27 

KOI 70 

B 

0 

5 

4 

0.32 

0.27 

0.70 

-0.17 

KOI 70 

C 

0 

3 

3 

-0.32 

0.69 

0.47 

-0.21 

KOI 70 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0171 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0171 

A 

1 

11 

58 

1.89 

0.44 

1.00 

0.59 

K0171 

B 

0 

2 

11 

0.57 

0.41 

0.77 

-0.15 

K0171 

C 

0 

6 

32 

0.11 

0.27 

0.52 

-0.53 

K0171 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 72 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 72 

A 

1 

12 

71 

2.63 

0.45 

0.60 

0.60 

KOI 72 

B 

0 

2 

12 

2.12 

1.39 

6.16 

0.06 

KOI 72 

C 

0 

1 

6 

-0.56 

0.00 

0.20 

-0.27 

KOI 72 

D 

0 

2 

12 

-2.52 

0.42 

0.03 

-0.71 

KOI 73 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

KOI 73 

A 

1 

11 

58 

2.93 

0.62 

1.01 

0.63 

KOI 73 

B 

0 

7 

37 

0.45 

0.37 

1.12 

-0.51 

KOI 73 

C 

0 

1 

5 

-0.71 

0.00 

0.23 

-0.29 

KOI 73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 74 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

KOI 74 

A 

1 

12 

67 

2.97 

0.42 

0.66 

0.69 

KOI 74 

B 

0 

4 

22 

1.03 

0.12 

0.72 

-0.27 

KOI 74 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 74 

D 

0 

2 

11 

-1.81 

1.07 

0.07 

-0.68 

KOI 75 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

KOI 75 

A 

1 

11 

61 

2.63 

0.28 

0.63 

0.66 

KOI 75 

B 

0 

5 

28 

1.20 

0.47 

0.85 

-0.41 

KOI 75 

C 

0 

1 

6 

0.93 

0.00 

0.43 

-0.21 

KOI 75 

D 

0 

1 

6 

-0.03 

0.00 

0.17 

-0.41 

KOI 76 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

KOI 76 

A 

1 

8 

44 

1.73 

0.61 

1.22 

0.51 

KOI 76 

B 

0 

7 

39 

0.50 

0.32 

1.10 

-0.23 

KOI 76 

C 

0 

3 

17 

-0.34 

0.26 

0.37 

-0.39 

KOI 76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 77 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 77 

A 

1 

13 

72 

1.76 

0.44 

1.04 

0.28 

KOI 77 

B 

0 

3 

17 

0.68 

0.69 

1.07 

-0.23 

KOI 77 

C 

0 

1 

6 

2.80 

0.00 

6.32 

0.21 

KOI 77 

D 

0 

1 

6 

-0.96 

0.00 

0.15 

-0.38 

KOI 78 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 78 

A 

1 

15 

83 

2.17 

0.38 

1.03 

0.65 

K0178 

B 

0 

1 

6 

0.19 

0.00 

0.40 

-0.17 

KOI 78 

C 

0 

1 

6 

-0.03 

0.00 

0.32 

-0.20 

KOI 78 

D 

0 

1 

6 

-4.07 

0.00 

0.00 

-0.69 

KOI 79 

* 

-1 

1298 

98 

1.39 

0.04 

0.00 

0.05 

KOI 79 

A 

1 

17 

81 

1.30 

0.35 

0.65 

0.57 

KOI 79 

B 

0 

1 

5 

-0.21 

0.00 

0.65 

-0.14 

KOI 79 

C 

0 

1 

5 

-0.17 

0.00 

0.68 

-0.13 

KOI 79 

D 

0 

2 

10 

-2.10 

0.98 

0.15 

-0.57 

KOI 80 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 80 

A 

1 

17 

89 

1.84 

0.39 

1.04 

0.37 

KOI 80 

B 

0 

1 

5 

-0.17 

0.00 

0.39 

-0.27 

KOI 80 

C 

0 

1 

5 

-0.02 

0.00 

0.46 

-0.24 

KOI 80 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0181 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0181 

A 

1 

14 

78 

2.39 

0.39 

0.62 

0.66 

K0181 

B 

0 

3 

17 

-0.29 

0.40 

0.32 

-0.56 

K0181 

C 

0 

1 

6 

-0.15 

0.00 

0.31 

-0.28 

K0181 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 82 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 82 

A 

1 

15 

83 

1.90 

0.42 

0.71 

0.55 

KOI 82 

B 

0 

1 

6 

0.07 

0.00 

0.67 

-0.19 

KOI 82 

C 

0 

1 

6 

-0.19 

0.00 

0.52 

-0.22 

KOI 82 

D 

0 

1 

6 

-2.21 

0.00 

0.07 

-0.49 

KOI 83 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 83 

A 

1 

14 

82 

2.19 

0.48 

1.22 

0.60 

KOI 83 

B 

0 

2 

12 

0.25 

0.63 

0.70 

-0.19 

KOI 83 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 83 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.71 

KOI 84 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

KOI 84 

A 

1 

16 

89 

1.58 

0.41 

1.11 

0.53 

KOI 84 

B 

0 

1 

6 

0.82 

0.00 

1.24 

-0.04 

KOI 84 

C 

0 

1 

6 

-4.58 

0.00 

0.00 

-0.68 

KOI 84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 85 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

KOI 85 

A 

1 

14 

82 

1.92 

0.35 

1.13 

0.37 

KOI 85 

B 

0 

2 

12 

0.91 

0.07 

0.75 

-0.23 

KOI 85 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 85 

D 

0 

1 

6 

0.24 

0.00 

0.38 

-0.29 

KOI 86 

* 

-1 

1197 

91 

1.39 

0.04 

0.00 

0.01 

KOI 86 

A 

1 

97 

80 

1.78 

0.11 

0.77 

0.57 

KOI 86 

B 

0 

12 

10 

0.12 

0.33 

0.81 

-0.28 

KOI 86 

C 

0 

11 

9 

0.10 

0.22 

0.50 

-0.27 

KOI 86 

D 

0 

2 

2 

-4.90 

0.51 

0.00 

-0.55 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 87 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

KOI 87 

A 

1 

16 

89 

1.32 

0.39 

1.18 

0.20 

KOI 87 

B 

0 

1 

6 

0.66 

0.00 

1.15 

-0.09 

KOI 87 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 87 

D 

0 

1 

6 

0.12 

0.00 

0.67 

-0.18 

K0188 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

K0188 

A 

1 

16 

84 

2.30 

0.38 

0.82 

0.69 

K0188 

B 

0 

1 

5 

-0.15 

0.00 

0.34 

-0.19 

K0188 

C 

0 

1 

5 

-5.05 

0.00 

0.00 

-0.71 

K0188 

D 

0 

1 

5 

-0.55 

0.00 

0.23 

-0.23 

KOI 89 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

KOI 89 

A 

1 

13 

72 

1.36 

0.40 

1.07 

0.53 

KOI 89 

B 

0 

2 

11 

-1.65 

1.34 

0.41 

-0.53 

KOI 89 

C 

0 

3 

17 

0.10 

0.59 

0.89 

-0.19 

KOI 89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 90 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

KOI 90 

A 

1 

15 

83 

2.11 

0.34 

0.50 

0.79 

KOI 90 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 90 

C 

0 

1 

6 

-0.29 

0.00 

0.39 

-0.16 

KOI 90 

D 

0 

2 

11 

-4.18 

1.24 

0.03 

-0.82 

K0191 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

K0191 

A 

1 

18 

95 

2.16 

0.32 

0.91 

0.38 

K0191 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0191 

C 

0 

1 

5 

-0.21 

0.00 

0.25 

-0.38 

K0191 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 92 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 92 

A 

1 

11 

61 

2.61 

0.52 

0.61 

0.65 

KOI 92 

B 

0 

2 

11 

1.06 

0.92 

1.71 

-0.09 

KOI 92 

C 

0 

1 

6 

0.19 

0.00 

0.49 

-0.16 

KOI 92 

D 

0 

4 

22 

-0.74 

0.80 

0.34 

-0.60 

KOI 93 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 93 

A 

1 

14 

82 

1.83 

0.37 

0.89 

0.47 

KOI 93 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 93 

C 

0 

2 

12 

-0.21 

0.06 

0.31 

-0.46 

KOI 93 

D 

0 

1 

6 

0.75 

0.00 

0.81 

-0.14 

KOI 94 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 94 

A 

1 

13 

68 

2.50 

0.44 

0.68 

0.71 

KOI 94 

B 

0 

2 

11 

0.52 

0.27 

0.70 

-0.16 

KOI 94 

C 

0 

1 

5 

-0.79 

0.00 

0.18 

-0.26 

KOI 94 

D 

0 

3 

16 

-1.46 

0.93 

0.29 

-0.62 

KOI 95 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

KOI 95 

A 

1 

15 

83 

1.99 

0.46 

1.12 

0.15 

KOI 95 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 95 

C 

0 

2 

11 

2.79 

0.53 

8.10 

0.18 

KOI 95 

D 

0 

1 

6 

-1.93 

0.00 

0.06 

-0.49 

KOI 96 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

KOI 96 

A 

1 

9 

50 

2.25 

0.46 

1.34 

0.39 

KOI 96 

B 

0 

1 

6 

1.49 

0.00 

0.83 

-0.07 

KOI 96 

C 

0 

8 

44 

1.34 

0.30 

0.94 

-0.36 

KOI 96 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOI 97 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 97 

A 

1 

12 

67 

1.91 

0.26 

0.83 

0.40 

KOI 97 

B 

0 

6 

33 

0.86 

0.68 

1.45 

-0.40 

KOI 97 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 97 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOI 98 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

KOI 98 

A 

1 

4 

22 

3.41 

0.82 

0.69 

0.49 

KOI 98 

B 

0 

11 

61 

1.71 

0.34 

1.20 

0.09 

KOI 98 

C 

0 

2 

11 

0.00 

0.20 

0.13 

-0.28 

KOI 98 

D 

0 

1 

6 

-4.14 

0.00 

0.00 

-0.69 

KOI 99 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

KOI 99 

A 

1 

13 

72 

1.75 

0.45 

0.97 

0.51 

KOI 99 

B 

0 

1 

6 

0.56 

0.00 

0.90 

-0.07 

KOI 99 

C 

0 

1 

6 

0.16 

0.00 

0.60 

-0.12 

KOI 99 

D 

0 

3 

17 

-0.96 

1.61 

0.69 

-0.49 

K0200 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0200 

A 

1 

13 

76 

1.94 

0.39 

0.86 

0.52 

K0200 

B 

0 

1 

6 

-2.99 

0.00 

0.00 

-0.61 

K0200 

C 

0 

3 

18 

0.67 

1.03 

1.87 

-0.20 

K0200 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0301 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.04 

K0301 

A 

1 

16 

89 

2.24 

0.33 

0.77 

0.56 

K0301 

B 

0 

1 

6 

0.09 

0.00 

0.35 

-0.31 

K0301 

C 

0 

1 

6 

-0.77 

0.00 

0.15 

-0.46 

K0301 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0302 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0302 

A 

1 

14 

78 

2.41 

0.43 

0.68 

0.66 

K0302 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0302 

C 

0 

3 

17 

-0.41 

0.25 

0.32 

-0.52 

K0302 

D 

0 

1 

6 

-0.97 

0.00 

0.17 

-0.36 

K0303 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0303 

A 

1 

14 

78 

1.57 

0.51 

1.42 

0.16 

K0303 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0303 

C 

0 

1 

6 

1.68 

0.00 

2.69 

0.04 

K0303 

D 

0 

3 

17 

0.69 

0.39 

1.17 

-0.20 

K0304 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0304 

A 

1 

11 

61 

2.08 

0.51 

1.10 

0.51 

K0304 

B 

0 

1 

6 

0.96 

0.00 

0.99 

-0.08 

K0304 

C 

0 

6 

33 

0.42 

0.25 

0.66 

-0.49 

K0304 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0305 

* 

-1 

1295 

98 

1.39 

0.04 

0.00 

0.02 

K0305 

A 

1 

14 

58 

1.78 

0.45 

1.12 

0.43 

K0305 

B 

0 

7 

29 

0.02 

0.53 

0.95 

-0.38 

K0305 

C 

0 

1 

4 

-0.55 

0.00 

0.27 

-0.19 

K0305 

D 

0 

2 

8 

1.04 

2.96 

12.62 

-0.01 

K0306 

* 

-1 

1202 

91 

1.39 

0.04 

0.00 

0.02 

K0306 

A 

1 

108 

92 

1.38 

0.12 

0.93 

0.29 

K0306 

B 

0 

2 

2 

-0.45 

0.34 

0.34 

-0.17 

K0306 

C 

0 

6 

5 

0.50 

0.36 

1.10 

-0.14 

K0306 

D 

0 

1 

1 

-2.36 

0.00 

0.05 

-0.26 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0307 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0307 

A 

1 

16 

89 

2.40 

0.45 

1.08 

0.42 

K0307 

B 

0 

2 

11 

-0.06 

0.22 

0.44 

-0.42 

K0307 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0307 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0308 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0308 

A 

1 

13 

76 

1.59 

0.50 

1.09 

0.32 

K0308 

B 

0 

3 

18 

0.69 

0.59 

1.67 

-0.17 

K0308 

C 

0 

1 

6 

-0.72 

0.00 

0.28 

-0.30 

K0308 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0309 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0309 

A 

1 

13 

72 

1.97 

0.38 

0.63 

0.65 

K0309 

B 

0 

1 

6 

0.19 

0.00 

0.57 

-0.17 

K0309 

C 

0 

2 

11 

0.03 

0.19 

0.50 

-0.29 

K0309 

D 

0 

2 

11 

-0.99 

1.10 

0.29 

-0.51 

K0310 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0310 

A 

1 

5 

28 

3.84 

0.89 

1.25 

0.70 

K0310 

B 

0 

8 

44 

1.33 

0.24 

1.21 

-0.02 

K0310 

C 

0 

3 

17 

-0.31 

0.78 

0.30 

-0.34 

K0310 

D 

0 

2 

11 

-2.08 

0.41 

0.04 

-0.56 

K0311 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.06 

K0311 

A 

1 

7 

41 

3.32 

0.51 

0.64 

0.65 

K0311 

B 

0 

2 

12 

0.71 

0.04 

0.28 

-0.35 

K0311 

C 

0 

6 

35 

1.15 

0.48 

0.80 

-0.49 

K0311 

D 

0 

2 

12 

2.53 

0.15 

1.78 

0.09 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0312 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.08 

K0312 

A 

1 

15 

83 

2.55 

0.37 

1.06 

0.28 

K0312 

B 

0 

2 

11 

2.01 

1.20 

2.98 

-0.09 

K0312 

C 

0 

1 

6 

0.47 

0.00 

0.35 

-0.32 

K0312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0313 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0313 

A 

1 

15 

79 

1.80 

0.34 

0.87 

0.52 

K0313 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0313 

C 

0 

1 

5 

-0.64 

0.00 

0.23 

-0.31 

K0313 

D 

0 

3 

16 

-0.03 

1.18 

1.15 

-0.40 

K0314 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0314 

A 

1 

15 

83 

2.15 

0.39 

0.84 

0.51 

K0314 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0314 

C 

0 

2 

11 

0.96 

0.90 

1.58 

-0.15 

K0314 

D 

0 

1 

6 

-2.88 

0.00 

0.02 

-0.62 

K0315 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0315 

A 

1 

13 

72 

2.20 

0.57 

1.43 

0.30 

K0315 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0315 

C 

0 

4 

22 

0.80 

0.32 

0.94 

-0.32 

K0315 

D 

0 

1 

6 

1.85 

0.00 

2.36 

0.00 

K0316 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

K0316 

A 

1 

15 

88 

1.14 

0.34 

0.77 

0.50 

K0316 

B 

0 

1 

6 

-0.40 

0.00 

0.51 

-0.23 

K0316 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0316 

D 

0 

1 

6 

-1.63 

0.00 

0.15 

-0.45 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0317 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0317 

A 

1 

17 

94 

1.76 

0.34 

1.10 

0.13 

K0317 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0317 

C 

0 

1 

6 

1.01 

0.00 

0.97 

-0.13 

K0317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0318 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.04 

K0318 

A 

1 

16 

84 

1.35 

0.47 

1.52 

0.50 

K0318 

B 

0 

1 

5 

-0.69 

0.00 

0.62 

-0.20 

K0318 

C 

0 

1 

5 

-1.02 

0.00 

0.45 

-0.24 

K0318 

D 

0 

1 

5 

-2.21 

0.00 

0.14 

-0.38 

K0319 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0319 

A 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0319 

B 

-1 

12 

71 

2.32 

0.32 

0.00 

0.56 

K0319 

C 

-1 

4 

24 

1.06 

0.50 

0.00 

-0.37 

K0319 

D 

-1 

1 

6 

-0.20 

0.00 

0.00 

-0.42 

K0320 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0320 

A 

1 

9 

50 

1.74 

0.43 

1.03 

0.45 

K0320 

B 

0 

5 

28 

0.41 

0.46 

0.71 

-0.41 

K0320 

C 

0 

1 

6 

0.96 

0.00 

0.82 

-0.05 

K0320 

D 

0 

3 

17 

1.00 

0.61 

1.15 

-0.08 

K0321 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0321 

A 

1 

11 

61 

1.69 

0.51 

1.22 

0.47 

K0321 

B 

0 

1 

6 

1.40 

0.00 

1.87 

0.06 

K0321 

C 

0 

5 

28 

0.38 

0.13 

0.69 

-0.16 

K0321 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.74 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0322 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0322 

A 

1 

11 

61 

2.33 

0.43 

0.78 

0.57 

K0322 

B 

0 

4 

22 

-0.14 

0.30 

0.29 

-0.56 

K0322 

C 

0 

2 

11 

1.02 

2.05 

3.22 

-0.12 

K0322 

D 

0 

1 

6 

1.31 

0.00 

1.08 

-0.04 

K0323 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0323 

A 

1 

8 

44 

2.40 

0.65 

1.32 

0.56 

K0323 

B 

0 

1 

6 

0.10 

0.00 

0.37 

-0.17 

K0323 

C 

0 

7 

39 

0.57 

0.44 

0.99 

-0.35 

K0323 

D 

0 

2 

11 

0.32 

1.46 

1.04 

-0.21 

K0324 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.06 

K0324 

A 

1 

14 

74 

1.36 

0.34 

0.79 

0.56 

K0324 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0324 

C 

0 

2 

11 

1.73 

0.64 

4.66 

0.18 

K0324 

D 

0 

3 

16 

-3.22 

0.70 

0.06 

-0.83 

K0325 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0325 

A 

1 

8 

44 

2.74 

0.54 

1.04 

0.60 

K0325 

B 

0 

6 

33 

0.78 

0.35 

0.66 

-0.37 

K0325 

C 

0 

1 

6 

0.72 

0.00 

0.46 

-0.14 

K0325 

D 

0 

3 

17 

0.73 

1.34 

1.21 

-0.25 

K0326 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0326 

A 

1 

12 

67 

2.30 

0.45 

0.79 

0.54 

K0326 

B 

0 

4 

22 

0.64 

0.47 

0.77 

-0.36 

K0326 

C 

0 

2 

11 

0.18 

0.98 

0.57 

-0.34 

K0326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0327 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0327 

A 

1 

12 

67 

2.44 

0.49 

1.18 

0.59 

K0327 

B 

0 

1 

6 

-0.40 

0.00 

0.22 

-0.28 

K0327 

C 

0 

4 

22 

0.29 

0.75 

1.01 

-0.41 

K0327 

D 

0 

1 

6 

0.25 

0.00 

0.41 

-0.19 

K0328 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

K0328 

A 

1 

8 

42 

2.91 

0.69 

1.00 

0.72 

K0328 

B 

0 

6 

32 

0.28 

0.23 

0.67 

-0.32 

K0328 

C 

0 

3 

16 

-0.43 

0.65 

0.41 

-0.35 

K0328 

D 

0 

2 

11 

-0.31 

1.62 

0.85 

-0.26 

K0329 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0329 

A 

1 

13 

68 

1.69 

0.43 

1.67 

0.34 

K0329 

B 

0 

6 

32 

0.71 

0.21 

0.81 

-0.34 

K0329 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0330 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0330 

A 

1 

16 

84 

1.97 

0.33 

0.45 

0.74 

K0330 

B 

0 

1 

5 

-0.90 

0.00 

0.25 

-0.27 

K0330 

C 

0 

1 

5 

-1.09 

0.00 

0.20 

-0.29 

K0330 

D 

0 

1 

5 

-4.14 

0.00 

0.01 

-0.66 

K0331 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0331 

A 

1 

6 

35 

2.63 

0.81 

2.50 

0.37 

K0331 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0331 

C 

0 

11 

65 

1.45 

0.36 

1.68 

-0.37 

K0331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0332 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

K0332 

A 

1 

8 

47 

2.28 

0.36 

0.90 

0.43 

K0332 

B 

0 

1 

6 

1.10 

0.00 

0.51 

-0.15 

K0332 

C 

0 

5 

29 

1.34 

0.51 

1.18 

-0.24 

K0332 

D 

0 

3 

18 

1.29 

0.92 

1.32 

-0.19 

K0333 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0333 

A 

1 

6 

33 

3.10 

0.39 

0.50 

0.66 

K0333 

B 

0 

8 

44 

1.64 

0.26 

0.95 

-0.05 

K0333 

C 

0 

2 

11 

0.70 

0.64 

0.36 

-0.24 

K0333 

D 

0 

2 

11 

-1.07 

0.56 

0.06 

-0.67 

K0334 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0334 

A 

1 

13 

68 

2.32 

0.47 

0.80 

0.62 

K0334 

B 

0 

4 

21 

-0.09 

0.55 

0.66 

-0.47 

K0334 

C 

0 

2 

11 

-0.15 

0.00 

0.38 

-0.32 

K0334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0335 

* 

-1 

1296 

98 

1.39 

0.04 

0.00 

0.01 

K0335 

A 

1 

5 

22 

3.87 

0.60 

0.33 

0.74 

K0335 

B 

0 

3 

13 

0.52 

0.15 

0.35 

-0.15 

K0335 

C 

0 

11 

48 

1.01 

0.35 

1.02 

-0.13 

K0335 

D 

0 

4 

17 

-0.75 

0.75 

0.17 

-0.50 

K0336 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0336 

A 

1 

10 

59 

2.44 

0.65 

1.03 

0.61 

K0336 

B 

0 

3 

18 

0.30 

0.71 

1.12 

-0.21 

K0336 

C 

0 

2 

12 

-0.12 

1.52 

1.16 

-0.23 

K0336 

D 

0 

2 

12 

-1.41 

1.47 

0.30 

-0.45 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0337 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0337 

A 

1 

15 

83 

2.28 

0.45 

1.05 

0.35 

K0337 

B 

0 

1 

6 

1.04 

0.00 

1.01 

-0.14 

K0337 

C 

0 

2 

11 

0.55 

0.22 

0.64 

-0.31 

K0337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0338 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0338 

A 

1 

8 

44 

2.16 

0.60 

2.46 

0.30 

K0338 

B 

0 

8 

44 

0.55 

0.98 

2.09 

-0.36 

K0338 

C 

0 

2 

11 

2.00 

0.59 

1.35 

0.09 

K0338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0339 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.09 

K0339 

A 

1 

14 

78 

2.97 

0.32 

0.82 

0.53 

K0339 

B 

0 

1 

6 

-0.79 

0.00 

0.07 

-0.57 

K0339 

C 

0 

2 

11 

2.44 

0.23 

1.70 

-0.03 

K0339 

D 

0 

1 

6 

0.47 

0.00 

0.23 

-0.35 

K0340 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0340 

A 

1 

11 

61 

1.95 

0.53 

1.48 

0.44 

K0340 

B 

0 

5 

28 

0.77 

0.34 

1.01 

-0.25 

K0340 

C 

0 

1 

6 

-0.03 

0.00 

0.38 

-0.23 

K0340 

D 

0 

1 

6 

0.06 

0.00 

0.42 

-0.21 

K0341 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0341 

A 

1 

13 

76 

1.40 

0.40 

1.32 

0.20 

K0341 

B 

0 

1 

6 

1.69 

0.00 

2.38 

0.09 

K0341 

C 

0 

2 

12 

0.41 

0.23 

0.68 

-0.24 

K0341 

D 

0 

1 

6 

0.65 

0.00 

0.84 

-0.12 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0342 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0342 

A 

1 

17 

94 

2.03 

0.49 

1.31 

0.08 

K0342 

B 

0 

1 

6 

1.40 

0.00 

2.49 

-0.08 

K0342 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0343 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0343 

A 

1 

14 

82 

2.19 

0.38 

0.77 

0.68 

K0343 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0343 

C 

0 

3 

18 

-1.69 

1.68 

0.34 

-0.68 

K0343 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0344 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0344 

A 

1 

16 

89 

1.13 

0.35 

1.08 

0.33 

K0344 

B 

0 

1 

6 

0.17 

0.00 

0.85 

-0.15 

K0344 

C 

0 

1 

6 

-0.70 

0.00 

0.36 

-0.30 

K0344 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0345 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0345 

A 

1 

14 

82 

1.80 

0.50 

1.16 

0.51 

K0345 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0345 

C 

0 

2 

12 

-2.71 

2.30 

0.39 

-0.62 

K0345 

D 

0 

1 

6 

1.48 

0.00 

2.58 

0.02 

K0346 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.06 

K0346 

A 

1 

15 

88 

2.48 

0.31 

0.78 

0.59 

K0346 

B 

0 

2 

12 

0.00 

0.67 

0.28 

-0.59 

K0346 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0346 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0347 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0347 

A 

1 

13 

72 

1.76 

0.38 

1.02 

0.32 

K0347 

B 

0 

3 

17 

0.64 

1.31 

2.41 

-0.26 

K0347 

C 

0 

2 

11 

0.88 

0.61 

1.00 

-0.15 

K0347 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0348 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0348 

A 

1 

14 

78 

2.21 

0.36 

0.52 

0.72 

K0348 

B 

0 

1 

6 

-0.29 

0.00 

0.36 

-0.25 

K0348 

C 

0 

1 

6 

0.18 

0.00 

0.58 

-0.18 

K0348 

D 

0 

2 

11 

-1.69 

0.68 

0.11 

-0.64 

K0349 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0349 

A 

1 

12 

67 

2.20 

0.54 

1.64 

0.34 

K0349 

B 

0 

1 

6 

-0.73 

0.00 

0.15 

-0.36 

K0349 

C 

0 

5 

28 

1.33 

0.37 

1.57 

-0.17 

K0349 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0350 

* 

-1 

1302 

99 

1.40 

0.04 

0.00 

0.13 

K0350 

A 

1 

12 

71 

0.38 

0.35 

1.05 

0.62 

K0350 

B 

0 

2 

12 

-1.24 

0.60 

0.51 

-0.21 

K0350 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0350 

D 

0 

3 

18 

-2.30 

1.34 

0.84 

-0.56 

K0351 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.03 

K0351 

A 

1 

16 

80 

2.18 

0.32 

0.81 

0.60 

K0351 

B 

0 

4 

20 

-0.03 

0.59 

0.47 

-0.60 

K0351 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0351 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0352 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0352 

A 

1 

16 

89 

1.43 

0.29 

0.83 

0.50 

K0352 

B 

0 

1 

6 

-0.11 

0.00 

0.44 

-0.26 

K0352 

C 

0 

1 

6 

-0.88 

0.00 

0.20 

-0.42 

K0352 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0353 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0353 

A 

1 

17 

89 

1.85 

0.39 

0.65 

0.54 

K0353 

B 

0 

1 

5 

-0.32 

0.00 

0.47 

-0.24 

K0353 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0353 

D 

0 

1 

5 

-2.37 

0.00 

0.06 

-0.51 

K0354 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0354 

A 

1 

11 

61 

2.31 

0.53 

0.82 

0.68 

K0354 

B 

0 

2 

11 

0.24 

0.97 

1.10 

-0.15 

K0354 

C 

0 

3 

17 

-0.14 

0.41 

0.58 

-0.27 

K0354 

D 

0 

2 

11 

-2.36 

0.72 

0.07 

-0.58 

K0355 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.05 

K0355 

A 

1 

15 

88 

0.97 

0.40 

0.64 

0.44 

K0355 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0355 

C 

0 

1 

6 

0.99 

0.00 

3.65 

0.04 

K0355 

D 

0 

1 

6 

-4.14 

0.00 

0.02 

-0.65 

K0356 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0356 

A 

1 

13 

72 

2.27 

0.39 

0.50 

0.74 

K0356 

B 

0 

1 

6 

-1.14 

0.00 

0.14 

-0.36 

K0356 

C 

0 

4 

22 

-0.52 

0.15 

0.27 

-0.60 

K0356 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0357 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0357 

A 

1 

15 

83 

1.55 

0.18 

1.11 

-0.10 

K0357 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0357 

C 

0 

3 

17 

1.71 

0.37 

1.51 

0.10 

K0357 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0358 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0358 

A 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0358 

B 

-1 

14 

78 

2.62 

0.38 

0.00 

0.61 

K0358 

C 

-1 

3 

17 

0.28 

0.64 

0.00 

-0.50 

K0358 

D 

-1 

1 

6 

0.16 

0.00 

0.00 

-0.29 

K0359 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0359 

A 

1 

11 

61 

2.26 

0.46 

1.02 

0.50 

K0359 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0359 

C 

0 

6 

33 

1.02 

0.37 

1.03 

-0.17 

K0359 

D 

0 

1 

6 

-4.40 

0.00 

0.00 

-0.72 

K0360 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0360 

A 

1 

12 

67 

2.44 

0.51 

0.68 

0.69 

K0360 

B 

0 

2 

11 

-0.44 

0.29 

0.33 

-0.25 

K0360 

C 

0 

1 

6 

1.16 

0.00 

1.55 

-0.01 

K0360 

D 

0 

3 

17 

-2.24 

1.39 

0.33 

-0.65 

K0361 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0361 

A 

1 

15 

88 

2.26 

0.42 

0.61 

0.56 

K0361 

B 

0 

1 

6 

0.15 

0.00 

0.58 

-0.23 

K0361 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0361 

D 

0 

1 

6 

-2.09 

0.00 

0.06 

-0.54 



easyCBM CCSS Kindergarten Math Measure Development 


277 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0362 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

K0362 

A 

1 

13 

76 

1.77 

0.39 

0.49 

0.78 

K0362 

B 

0 

1 

6 

-5.05 

0.00 

0.00 

-0.65 

K0362 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0362 

D 

0 

3 

18 

-1.46 

0.45 

0.19 

-0.46 

K0363 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0363 

A 

1 

12 

67 

2.47 

0.39 

0.84 

0.59 

K0363 

B 

0 

3 

17 

1.59 

0.14 

1.17 

-0.07 

K0363 

C 

0 

1 

6 

0.12 

0.00 

0.26 

-0.28 

K0363 

D 

0 

2 

11 

-0.68 

0.21 

0.12 

-0.59 

K0364 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0364 

A 

1 

11 

61 

2.26 

0.55 

1.43 

0.46 

K0364 

B 

0 

4 

22 

1.06 

0.40 

1.15 

-0.21 

K0364 

C 

0 

3 

17 

0.38 

0.22 

0.48 

-0.36 

K0364 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0365 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.08 

K0365 

A 

1 

14 

78 

3.05 

0.29 

0.52 

0.77 

K0365 

B 

0 

4 

22 

0.31 

0.28 

0.27 

-0.77 

K0365 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0365 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0366 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0366 

A 

1 

9 

50 

2.86 

0.37 

0.55 

0.65 

K0366 

B 

0 

6 

33 

-0.16 

1.06 

0.67 

-0.48 

K0366 

C 

0 

1 

6 

1.88 

0.00 

1.22 

0.05 

K0366 

D 

0 

2 

11 

-0.91 

1.45 

0.17 

-0.36 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0367 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0367 

A 

1 

7 

39 

3.10 

0.66 

0.84 

0.65 

K0367 

B 

0 

2 

11 

1.03 

2.14 

2.79 

-0.12 

K0367 

C 

0 

8 

44 

0.65 

0.32 

0.61 

-0.48 

K0367 

D 

0 

1 

6 

0.22 

0.00 

0.29 

-0.19 

K0368 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0368 

A 

1 

14 

82 

2.31 

0.33 

0.28 

0.83 

K0368 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0368 

C 

0 

1 

6 

-0.88 

0.00 

0.28 

-0.27 

K0368 

D 

0 

2 

12 

-3.25 

0.89 

0.04 

-0.79 

K0369 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

K0369 

A 

1 

16 

84 

1.71 

0.41 

0.60 

0.62 

K0369 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0369 

C 

0 

1 

5 

-0.88 

0.00 

0.35 

-0.26 

K0369 

D 

0 

2 

11 

-1.75 

0.61 

0.18 

-0.55 

K0370 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0370 

A 

1 

7 

41 

1.68 

0.48 

1.72 

0.19 

K0370 

B 

0 

4 

24 

0.78 

0.38 

0.58 

-0.28 

K0370 

C 

0 

4 

24 

1.60 

0.70 

2.24 

0.09 

K0370 

D 

0 

2 

12 

1.25 

1.73 

2.25 

-0.04 

K0371 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0371 

A 

1 

10 

56 

2.32 

0.56 

1.07 

0.50 

K0371 

B 

0 

2 

11 

1.58 

0.87 

2.15 

0.00 

K0371 

C 

0 

6 

33 

0.41 

0.36 

0.60 

-0.52 

K0371 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0372 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

K0372 

A 

1 

10 

59 

2.76 

0.46 

0.94 

0.45 

K0372 

B 

0 

1 

6 

0.75 

0.00 

0.35 

-0.16 

K0372 

C 

0 

5 

29 

2.00 

0.32 

1.52 

0.00 

K0372 

D 

0 

1 

6 

-4.14 

0.00 

0.00 

-0.78 

K0373 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0373 

A 

1 

12 

67 

1.73 

0.27 

0.62 

0.72 

K0373 

B 

0 

2 

11 

1.12 

0.03 

1.28 

0.05 

K0373 

C 

0 

2 

11 

-0.91 

0.16 

0.17 

-0.39 

K0373 

D 

0 

2 

11 

-2.54 

0.45 

0.05 

-0.74 

K0374 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

K0374 

A 

1 

16 

94 

1.91 

0.47 

1.12 

0.21 

K0374 

B 

0 

1 

6 

0.25 

0.00 

0.81 

-0.21 

K0374 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0374 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0375 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0375 

A 

1 

16 

84 

1.77 

0.50 

0.83 

0.47 

K0375 

B 

0 

1 

5 

-1.83 

0.00 

0.14 

-0.37 

K0375 

C 

0 

2 

11 

-0.39 

0.36 

0.64 

-0.29 

K0375 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0376 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0376 

A 

1 

13 

72 

2.43 

0.42 

0.69 

0.66 

K0376 

B 

0 

2 

11 

0.61 

0.54 

0.77 

-0.21 

K0376 

C 

0 

1 

6 

-2.49 

0.00 

0.03 

-0.55 

K0376 

D 

0 

2 

11 

-0.02 

0.18 

0.36 

-0.33 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0377 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0377 

A 

1 

11 

61 

2.29 

0.53 

1.26 

0.52 

K0377 

B 

0 

4 

22 

0.45 

0.74 

1.26 

-0.35 

K0377 

C 

0 

2 

11 

0.61 

0.73 

0.82 

-0.20 

K0377 

D 

0 

1 

6 

0.16 

0.00 

0.40 

-0.20 

K0378 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0378 

A 

1 

9 

50 

2.58 

0.55 

1.48 

0.45 

K0378 

B 

0 

3 

17 

0.69 

0.02 

0.37 

-0.19 

K0378 

C 

0 

5 

28 

0.19 

1.43 

1.40 

-0.40 

K0378 

D 

0 

1 

6 

2.64 

0.00 

2.61 

0.12 

K0379 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0379 

A 

1 

15 

83 

2.10 

0.43 

0.94 

0.48 

K0379 

B 

0 

2 

11 

-0.04 

0.84 

0.59 

-0.37 

K0379 

C 

0 

1 

6 

-0.19 

0.00 

0.37 

-0.27 

K0379 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0380 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0380 

A 

1 

10 

56 

1.75 

0.49 

1.86 

-0.02 

K0380 

B 

0 

7 

39 

2.04 

0.45 

2.58 

0.15 

K0380 

C 

0 

1 

6 

0.22 

0.00 

0.26 

-0.28 

K0380 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0381 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0381 

A 

1 

14 

78 

2.70 

0.43 

1.03 

0.63 

K0381 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0381 

C 

0 

3 

17 

0.46 

0.47 

0.64 

-0.34 

K0381 

D 

0 

1 

6 

-2.94 

0.00 

0.02 

-0.59 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0382 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

K0382 

A 

1 

14 

74 

2.42 

0.57 

1.54 

0.55 

K0382 

B 

0 

3 

16 

0.10 

0.44 

0.74 

-0.26 

K0382 

C 

0 

1 

5 

1.31 

0.00 

2.00 

-0.03 

K0382 

D 

0 

1 

5 

-5.05 

0.00 

0.00 

-0.62 

K0383 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0383 

A 

1 

11 

65 

2.25 

0.43 

1.10 

0.30 

K0383 

B 

0 

2 

12 

2.61 

0.74 

3.69 

0.16 

K0383 

C 

0 

2 

12 

1.54 

1.47 

2.25 

-0.09 

K0383 

D 

0 

2 

12 

-0.29 

1.08 

0.26 

-0.52 

K0384 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0384 

A 

1 

8 

44 

2.88 

0.69 

1.08 

0.66 

K0384 

B 

0 

3 

17 

-0.68 

0.21 

0.16 

-0.50 

K0384 

C 

0 

5 

28 

1.17 

0.32 

1.18 

-0.09 

K0384 

D 

0 

2 

11 

-0.24 

0.89 

0.34 

-0.31 

K0385 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0385 

A 

1 

9 

53 

1.73 

0.60 

1.85 

0.30 

K0385 

B 

0 

7 

41 

1.00 

0.20 

1.02 

-0.21 

K0385 

C 

0 

1 

6 

0.22 

0.00 

0.41 

-0.21 

K0385 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0386 

* 

-1 

1203 

91 

1.37 

0.04 

0.00 

-0.02 

K0386 

A 

1 

101 

87 

1.61 

0.13 

1.03 

0.26 

K0386 

B 

0 

5 

4 

1.23 

0.36 

1.81 

-0.04 

K0386 

C 

0 

9 

8 

0.55 

0.33 

0.97 

-0.20 

K0386 

D 

0 

1 

1 

-2.24 

0.00 

0.04 

-0.26 



easyCBM CCSS Kindergarten Math Measure Development 


282 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0387 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0387 

A 

1 

13 

68 

2.10 

0.46 

1.24 

0.55 

K0387 

B 

0 

2 

11 

-0.32 

0.39 

0.33 

-0.37 

K0387 

C 

0 

4 

21 

0.37 

0.42 

0.76 

-0.35 

K0387 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0388 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0388 

A 

-1 

18 

100 

2.19 

0.52 

0.00 

0.00 

K0388 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0388 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0388 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0389 

* 

-1 

1201 

91 

1.42 

0.04 

0.00 

0.08 

K0389 

A 

1 

63 

53 

1.53 

0.15 

0.93 

0.45 

K0389 

B 

0 

21 

18 

0.31 

0.35 

1.73 

-0.25 

K0389 

C 

0 

34 

29 

0.40 

0.13 

0.75 

-0.29 

K0389 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0390 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0390 

A 

1 

15 

79 

1.69 

0.47 

0.89 

0.56 

K0390 

B 

0 

1 

5 

-0.29 

0.00 

0.48 

-0.15 

K0390 

C 

0 

2 

11 

-0.26 

0.62 

0.59 

-0.22 

K0390 

D 

0 

1 

5 

-4.07 

0.00 

0.00 

-0.57 

K0391 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0391 

A 

1 

17 

89 

1.95 

0.32 

0.51 

0.66 

K0391 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0391 

C 

0 

1 

5 

-0.47 

0.00 

0.33 

-0.28 

K0391 

D 

0 

1 

5 

-2.88 

0.00 

0.03 

-0.62 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0392 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0392 

A 

1 

7 

39 

2.99 

0.73 

1.32 

0.62 

K0392 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0392 

C 

0 

9 

50 

0.90 

0.41 

0.94 

-0.26 

K0392 

D 

0 

2 

11 

-1.63 

0.62 

0.05 

-0.54 

K0393 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0393 

A 

1 

12 

67 

1.99 

0.44 

1.43 

0.59 

K0393 

B 

0 

1 

6 

0.61 

0.00 

0.63 

-0.06 

K0393 

C 

0 

4 

22 

-1.30 

1.28 

0.40 

-0.62 

K0393 

D 

0 

1 

6 

0.75 

0.00 

0.72 

-0.04 

K0394 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0394 

A 

1 

10 

56 

1.60 

0.49 

1.32 

0.39 

K0394 

B 

0 

6 

33 

0.88 

0.41 

1.26 

-0.11 

K0394 

C 

0 

1 

6 

-0.47 

0.00 

0.26 

-0.27 

K0394 

D 

0 

1 

6 

-0.97 

0.00 

0.16 

-0.35 

K0395 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0395 

A 

1 

17 

89 

1.64 

0.44 

1.12 

0.17 

K0395 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0395 

C 

0 

2 

11 

0.67 

0.02 

1.07 

-0.17 

K0395 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0396 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0396 

A 

1 

13 

72 

2.05 

0.43 

0.64 

0.71 

K0396 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0396 

C 

0 

3 

17 

-0.27 

0.10 

0.42 

-0.26 

K0396 

D 

0 

2 

11 

-3.38 

1.74 

0.11 

-0.69 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0397 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0397 

A 

1 

16 

89 

1.64 

0.40 

1.02 

0.55 

K0397 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0397 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0397 

D 

0 

2 

11 

-1.77 

2.29 

0.78 

-0.55 

K0398 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0398 

A 

1 

14 

74 

2.10 

0.40 

0.56 

0.70 

K0398 

B 

0 

1 

5 

0.11 

0.00 

0.63 

-0.17 

K0398 

C 

0 

3 

16 

-0.84 

0.19 

0.25 

-0.54 

K0398 

D 

0 

1 

5 

-1.14 

0.00 

0.18 

-0.33 

K0399 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.04 

K0399 

A 

1 

9 

53 

1.85 

0.62 

1.38 

0.51 

K0399 

B 

0 

4 

24 

0.39 

0.64 

1.30 

-0.11 

K0399 

C 

0 

1 

6 

-0.89 

0.00 

0.21 

-0.20 

K0399 

D 

0 

3 

18 

-1.21 

1.85 

0.96 

-0.43 

K0400 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0400 

A 

1 

17 

94 

1.33 

0.24 

1.05 

0.25 

K0400 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0400 

C 

0 

1 

6 

0.28 

0.00 

0.57 

-0.25 

K0400 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0401 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0401 

A 

1 

15 

83 

1.39 

0.31 

1.01 

0.10 

K0401 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0401 

C 

0 

3 

17 

1.02 

1.45 

7.92 

-0.10 

K0401 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0402 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0402 

A 

1 

14 

78 

2.25 

0.40 

0.76 

0.53 

K0402 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0402 

C 

0 

3 

17 

0.67 

0.65 

0.95 

-0.29 

K0402 

D 

0 

1 

6 

-1.62 

0.00 

0.07 

-0.49 

K0403 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0403 

A 

1 

16 

89 

2.39 

0.45 

0.66 

0.49 

K0403 

B 

0 

1 

6 

1.32 

0.00 

2.16 

-0.08 

K0403 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0403 

D 

0 

1 

6 

-2.94 

0.00 

0.03 

-0.58 

K0404 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.00 

K0404 

A 

1 

12 

71 

1.98 

0.45 

1.21 

0.39 

K0404 

B 

0 

4 

24 

1.47 

0.75 

2.09 

0.01 

K0404 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0404 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.77 

K0405 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

K0405 

A 

1 

16 

84 

1.73 

0.44 

0.64 

0.60 

K0405 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0405 

C 

0 

2 

11 

-0.81 

0.25 

0.41 

-0.34 

K0405 

D 

0 

1 

5 

-3.08 

0.00 

0.04 

-0.50 

K0406 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

K0406 

A 

1 

15 

79 

1.65 

0.47 

0.70 

0.60 

K0406 

B 

0 

2 

11 

-0.39 

0.35 

0.67 

-0.24 

K0406 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0406 

D 

0 

2 

11 

-2.17 

0.08 

0.11 

-0.55 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0407 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.06 

K0407 

A 

1 

11 

61 

1.64 

0.51 

0.90 

0.59 

K0407 

B 

0 

2 

11 

-0.12 

0.34 

0.57 

-0.12 

K0407 

C 

0 

1 

6 

0.13 

0.00 

0.68 

-0.06 

K0407 

D 

0 

4 

22 

-1.66 

1.29 

0.64 

-0.57 

K0408 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0408 

A 

1 

13 

72 

1.72 

0.48 

1.07 

0.37 

K0408 

B 

0 

5 

28 

0.43 

0.30 

0.82 

-0.37 

K0408 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0408 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0409 

* 

-1 

1203 

91 

1.39 

0.04 

0.00 

0.02 

K0409 

A 

1 

34 

29 

2.04 

0.30 

2.64 

0.33 

K0409 

B 

0 

12 

10 

1.36 

0.43 

2.63 

0.01 

K0409 

C 

0 

69 

59 

0.98 

0.12 

1.23 

-0.27 

K0409 

D 

0 

1 

1 

-1.93 

0.00 

0.03 

-0.21 

K0410 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.03 

K0410 

A 

1 

12 

71 

2.35 

0.35 

0.90 

0.57 

K0410 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0410 

C 

0 

5 

29 

0.33 

0.82 

0.78 

-0.57 

K0410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0411 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0411 

A 

1 

8 

44 

2.66 

0.51 

1.46 

0.39 

K0411 

B 

0 

3 

17 

2.22 

0.67 

1.87 

0.10 

K0411 

C 

0 

6 

33 

1.49 

0.38 

0.79 

-0.10 

K0411 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.80 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0412 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0412 

A 

1 

6 

33 

3.82 

0.83 

2.17 

0.69 

K0412 

B 

0 

11 

61 

0.34 

0.54 

0.69 

-0.60 

K0412 

C 

0 

1 

6 

0.07 

0.00 

0.22 

-0.14 

K0412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0413 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0413 

A 

1 

9 

53 

2.97 

0.49 

0.49 

0.80 

K0413 

B 

0 

2 

12 

-0.57 

0.55 

0.22 

-0.38 

K0413 

C 

0 

3 

18 

0.80 

0.41 

0.88 

-0.16 

K0413 

D 

0 

3 

18 

-0.86 

0.17 

0.15 

-0.56 

K0414 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0414 

A 

1 

14 

78 

1.44 

0.46 

1.17 

0.45 

K0414 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0414 

C 

0 

3 

17 

0.55 

0.44 

1.19 

-0.08 

K0414 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.69 

K0415 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0415 

A 

1 

14 

78 

2.62 

0.51 

0.77 

0.62 

K0415 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0415 

C 

0 

3 

17 

0.14 

0.71 

0.93 

-0.32 

K0415 

D 

0 

1 

6 

-4.14 

0.00 

0.01 

-0.61 

K0416 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0416 

A 

1 

14 

78 

2.52 

0.41 

1.13 

0.39 

K0416 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0416 

C 

0 

3 

17 

1.01 

1.34 

3.31 

-0.32 

K0416 

D 

0 

1 

6 

0.99 

0.00 

0.65 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0417 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.01 

K0417 

A 

1 

9 

45 

1.92 

0.59 

1.55 

0.37 

K0417 

B 

0 

5 

25 

0.26 

0.65 

0.79 

-0.33 

K0417 

C 

0 

5 

25 

0.93 

0.84 

2.47 

-0.10 

K0417 

D 

0 

1 

5 

1.30 

0.00 

1.14 

0.01 

K0418 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

0.01 

K0418 

A 

1 

7 

44 

2.74 

0.73 

0.90 

0.64 

K0418 

B 

0 

3 

19 

-0.29 

0.84 

0.51 

-0.35 

K0418 

C 

0 

4 

25 

-0.36 

0.92 

0.53 

-0.44 

K0418 

D 

0 

2 

13 

1.43 

0.42 

1.62 

0.03 

K0419 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

K0419 

A 

1 

16 

84 

2.09 

0.42 

1.05 

0.30 

K0419 

B 

0 

1 

5 

0.94 

0.00 

0.86 

-0.14 

K0419 

C 

0 

2 

11 

0.72 

0.04 

0.69 

-0.25 

K0419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0420 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0420 

A 

1 

14 

78 

2.06 

0.45 

1.06 

0.57 

K0420 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0420 

C 

0 

2 

11 

0.14 

0.25 

0.48 

-0.19 

K0420 

D 

0 

2 

11 

-2.27 

3.14 

0.98 

-0.56 

K0421 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0421 

A 

1 

12 

67 

1.62 

0.60 

2.74 

0.52 

K0421 

B 

0 

2 

11 

-0.44 

0.04 

0.50 

-0.22 

K0421 

C 

0 

3 

17 

-0.08 

0.63 

1.08 

-0.20 

K0421 

D 

0 

1 

6 

-2.88 

0.00 

0.04 

-0.44 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0422 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0422 

A 

1 

15 

83 

1.88 

0.40 

2.06 

0.61 

K0422 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0422 

C 

0 

3 

17 

-1.56 

1.73 

0.49 

-0.61 

K0422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0423 

* 

-1 

1198 

91 

1.39 

0.04 

0.00 

0.00 

K0423 

A 

1 

81 

67 

1.85 

0.12 

0.81 

0.51 

K0423 

B 

0 

10 

8 

0.55 

0.24 

0.72 

-0.18 

K0423 

C 

0 

26 

21 

0.73 

0.22 

1.28 

-0.24 

K0423 

D 

0 

4 

3 

-2.43 

0.41 

0.04 

-0.52 

K0424 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

K0424 

A 

1 

12 

63 

1.82 

0.42 

0.66 

0.67 

K0424 

B 

0 

1 

5 

0.68 

0.00 

1.13 

-0.04 

K0424 

C 

0 

4 

21 

-0.32 

0.45 

0.56 

-0.39 

K0424 

D 

0 

2 

11 

-1.59 

0.63 

0.14 

-0.51 

K0425 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0425 

A 

1 

12 

71 

2.07 

0.41 

1.02 

0.58 

K0425 

B 

0 

1 

6 

-0.76 

0.00 

0.16 

-0.22 

K0425 

C 

0 

3 

18 

0.76 

0.95 

1.81 

-0.10 

K0425 

D 

0 

1 

6 

-5.41 

0.00 

0.00 

-0.74 

K0426 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0426 

A 

1 

17 

89 

1.76 

0.44 

0.63 

0.51 

K0426 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0426 

C 

0 

1 

5 

-0.11 

0.00 

0.81 

-0.18 

K0426 

D 

0 

1 

5 

-3.08 

0.00 

0.04 

-0.52 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0427 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0427 

A 

1 

15 

83 

1.87 

0.36 

0.88 

0.41 

K0427 

B 

0 

2 

11 

0.64 

0.57 

0.74 

-0.26 

K0427 

C 

0 

1 

6 

-0.11 

0.00 

0.30 

-0.31 

K0427 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0428 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

K0428 

A 

1 

13 

81 

2.18 

0.57 

2.15 

0.45 

K0428 

B 

0 

2 

13 

0.74 

0.20 

1.39 

-0.17 

K0428 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0428 

D 

0 

1 

6 

-2.37 

0.00 

0.06 

-0.49 

K0429 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0429 

A 

1 

13 

72 

1.32 

0.45 

1.03 

0.43 

K0429 

B 

0 

1 

6 

0.61 

0.00 

1.24 

-0.05 

K0429 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0429 

D 

0 

4 

22 

-0.33 

0.47 

0.65 

-0.43 

K0430 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0430 

A 

1 

16 

89 

1.96 

0.43 

0.61 

0.59 

K0430 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0430 

C 

0 

1 

6 

-0.99 

0.00 

0.30 

-0.32 

K0430 

D 

0 

1 

6 

-2.37 

0.00 

0.08 

-0.49 

K0431 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

K0431 

A 

1 

10 

63 

2.37 

0.44 

0.73 

0.64 

K0431 

B 

0 

2 

13 

0.82 

0.50 

0.81 

-0.22 

K0431 

C 

0 

3 

19 

0.32 

0.27 

0.47 

-0.45 

K0431 

D 

0 

1 

6 

0.27 

0.00 

0.41 

-0.25 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0432 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0432 

A 

1 

11 

61 

3.04 

0.41 

0.61 

0.77 

K0432 

B 

0 

1 

6 

-1.66 

0.00 

0.05 

-0.42 

K0432 

C 

0 

4 

22 

-0.57 

0.54 

0.22 

-0.63 

K0432 

D 

0 

2 

11 

1.49 

0.19 

1.13 

-0.05 

K0433 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.02 

K0433 

A 

1 

10 

63 

1.70 

0.58 

1.80 

0.41 

K0433 

B 

0 

1 

6 

0.39 

0.00 

0.68 

-0.10 

K0433 

C 

0 

1 

6 

1.65 

0.00 

2.40 

0.08 

K0433 

D 

0 

4 

25 

-0.38 

1.08 

1.09 

-0.45 

K0434 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0434 

A 

1 

10 

56 

2.46 

0.67 

1.75 

0.53 

K0434 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0434 

C 

0 

7 

39 

0.74 

0.20 

0.84 

-0.25 

K0434 

D 

0 

1 

6 

-4.07 

0.00 

0.00 

-0.61 

K0435 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

K0435 

A 

1 

8 

44 

1.19 

0.37 

1.38 

0.27 

K0435 

B 

0 

9 

50 

0.91 

0.25 

1.00 

0.13 

K0435 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0435 

D 

0 

1 

6 

-5.01 

0.00 

0.00 

-0.86 

K0436 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0436 

A 

1 

16 

89 

1.99 

0.34 

0.83 

0.55 

K0436 

B 

0 

1 

6 

-1.01 

0.00 

0.15 

-0.44 

K0436 

C 

0 

1 

6 

-0.27 

0.00 

0.32 

-0.32 

K0436 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0437 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0437 

A 

1 

15 

88 

1.82 

0.36 

0.67 

0.56 

K0437 

B 

0 

1 

6 

-0.67 

0.00 

0.25 

-0.36 

K0437 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0437 

D 

0 

1 

6 

-0.97 

0.00 

0.19 

-0.41 

K0438 

* 

-1 

1300 

99 

1.40 

0.04 

0.00 

0.08 

K0438 

A 

1 

15 

79 

1.28 

0.47 

1.27 

0.64 

K0438 

B 

0 

1 

5 

1.20 

0.00 

3.25 

0.07 

K0438 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0438 

D 

0 

3 

16 

-4.05 

1.22 

0.19 

-0.75 

K0439 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

K0439 

A 

1 

15 

79 

2.28 

0.42 

0.71 

0.58 

K0439 

B 

0 

1 

5 

-0.56 

0.00 

0.24 

-0.31 

K0439 

C 

0 

3 

16 

-0.06 

0.60 

0.57 

-0.45 

K0439 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0440 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.02 

K0440 

A 

1 

17 

89 

1.37 

0.37 

0.90 

0.45 

K0440 

B 

0 

1 

5 

-0.50 

0.00 

0.46 

-0.24 

K0440 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0440 

D 

0 

1 

5 

-1.38 

0.00 

0.19 

-0.38 

K0441 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0441 

A 

1 

14 

78 

2.05 

0.38 

0.83 

0.64 

K0441 

B 

0 

2 

11 

-2.71 

2.30 

0.23 

-0.68 

K0441 

C 

0 

1 

6 

0.17 

0.00 

0.42 

-0.13 

K0441 

D 

0 

1 

6 

0.47 

0.00 

0.56 

-0.10 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0442 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.02 

K0442 

A 

1 

15 

88 

1.46 

0.38 

0.78 

0.54 

K0442 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0442 

C 

0 

1 

6 

-0.69 

0.00 

0.38 

-0.29 

K0442 

D 

0 

1 

6 

-1.63 

0.00 

0.15 

-0.44 

K0443 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0443 

A 

1 

14 

78 

1.92 

0.38 

0.56 

0.76 

K0443 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0443 

C 

0 

2 

11 

-2.75 

2.27 

0.36 

-0.60 

K0443 

D 

0 

2 

11 

-1.48 

0.18 

0.13 

-0.40 

K0444 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0444 

A 

1 

9 

50 

2.46 

0.62 

1.15 

0.51 

K0444 

B 

0 

4 

22 

0.32 

0.23 

0.51 

-0.35 

K0444 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0444 

D 

0 

5 

28 

0.83 

0.88 

1.82 

-0.24 

K0445 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.02 

K0445 

A 

1 

7 

41 

1.88 

0.66 

1.19 

0.45 

K0445 

B 

0 

2 

12 

1.60 

0.15 

1.86 

0.13 

K0445 

C 

0 

4 

24 

0.49 

0.17 

0.64 

-0.21 

K0445 

D 

0 

4 

24 

-0.04 

0.83 

0.83 

-0.41 

K0446 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0446 

A 

1 

9 

50 

2.89 

0.58 

2.57 

0.50 

K0446 

B 

0 

4 

22 

1.57 

0.46 

0.86 

-0.04 

K0446 

C 

0 

3 

17 

1.66 

0.97 

1.34 

-0.01 

K0446 

D 

0 

2 

11 

-3.02 

1.89 

0.05 

-0.72 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0447 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.07 

K0447 

A 

1 

11 

65 

1.30 

0.34 

1.07 

0.56 

K0447 

B 

0 

2 

12 

0.29 

0.55 

0.78 

-0.04 

K0447 

C 

0 

1 

6 

0.45 

0.00 

0.79 

-0.01 

K0447 

D 

0 

3 

18 

-2.21 

1.73 

0.63 

-0.67 

K0448 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

K0448 

A 

1 

11 

69 

2.32 

0.49 

1.00 

0.52 

K0448 

B 

0 

1 

6 

1.41 

0.00 

1.35 

-0.04 

K0448 

C 

0 

1 

6 

2.42 

0.00 

3.72 

0.11 

K0448 

D 

0 

3 

19 

-0.70 

0.25 

0.17 

-0.66 

K0449 

* 

-1 

1300 

99 

1.40 

0.04 

0.00 

0.09 

K0449 

A 

1 

9 

47 

1.38 

0.53 

1.33 

0.54 

K0449 

B 

0 

4 

21 

-0.44 

0.17 

0.39 

-0.18 

K0449 

C 

0 

4 

21 

-1.17 

1.51 

1.31 

-0.37 

K0449 

D 

0 

2 

11 

-0.71 

1.50 

0.67 

-0.16 

K0450 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0450 

A 

1 

12 

67 

2.10 

0.53 

0.79 

0.62 

K0450 

B 

0 

1 

6 

0.75 

0.00 

1.24 

-0.06 

K0450 

C 

0 

3 

17 

-0.12 

0.50 

0.66 

-0.30 

K0450 

D 

0 

2 

11 

-1.82 

0.68 

0.12 

-0.54 

K0451 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

K0451 

A 

1 

8 

42 

2.21 

0.53 

1.07 

0.45 

K0451 

B 

0 

4 

21 

1.81 

0.59 

2.14 

0.16 

K0451 

C 

0 

4 

21 

1.08 

0.43 

0.96 

-0.05 

K0451 

D 

0 

3 

16 

-1.78 

0.90 

0.09 

-0.72 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0452 

* 

-1 

1304 

99 

1.39 

0.04 

0.00 

0.05 

K0452 

A 

1 

5 

33 

2.43 

0.84 

1.08 

0.51 

K0452 

B 

0 

3 

20 

0.64 

1.53 

3.27 

-0.02 

K0452 

C 

0 

6 

40 

-0.58 

0.99 

0.62 

-0.46 

K0452 

D 

0 

1 

7 

0.39 

0.00 

0.44 

-0.04 

K0453 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.06 

K0453 

A 

1 

9 

53 

1.35 

0.34 

0.88 

0.53 

K0453 

B 

0 

3 

18 

1.07 

0.59 

1.88 

0.15 

K0453 

C 

0 

2 

12 

0.12 

0.08 

0.53 

-0.10 

K0453 

D 

0 

3 

18 

-2.07 

1.00 

0.16 

-0.75 

K0454 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0454 

A 

1 

7 

39 

2.88 

0.58 

0.70 

0.69 

K0454 

B 

0 

3 

17 

0.70 

0.40 

0.67 

-0.19 

K0454 

C 

0 

6 

33 

0.91 

0.24 

0.83 

-0.21 

K0454 

D 

0 

2 

11 

-1.18 

1.32 

0.17 

-0.54 

K0455 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0455 

A 

-1 

18 

100 

1.79 

0.32 

0.00 

0.00 

K0455 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0455 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0455 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0456 

* 

-1 

1298 

98 

1.38 

0.04 

0.00 

-0.02 

K0456 

A 

1 

16 

76 

2.16 

0.38 

0.82 

0.57 

K0456 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0456 

C 

0 

4 

19 

0.18 

0.38 

0.56 

-0.45 

K0456 

D 

0 

1 

5 

-0.47 

0.00 

0.24 

-0.30 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0457 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0457 

A 

1 

11 

65 

2.29 

0.55 

0.75 

0.54 

K0457 

B 

0 

2 

12 

-0.22 

0.54 

0.45 

-0.29 

K0457 

C 

0 

3 

18 

1.01 

1.01 

2.76 

-0.10 

K0457 

D 

0 

1 

6 

-3.08 

0.00 

0.02 

-0.54 

K0458 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.07 

K0458 

A 

1 

15 

94 

2.43 

0.45 

1.24 

0.18 

K0458 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0458 

D 

0 

1 

6 

1.17 

0.00 

1.13 

-0.18 

K0459 

* 

-1 

1304 

99 

1.37 

0.04 

0.00 

-0.06 

K0459 

A 

1 

12 

80 

2.46 

0.45 

1.12 

0.33 

K0459 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0459 

C 

0 

1 

7 

3.15 

0.00 

5.74 

0.16 

K0459 

D 

0 

2 

13 

0.22 

0.25 

0.32 

-0.50 

K0460 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0460 

A 

1 

15 

83 

2.53 

0.38 

0.78 

0.56 

K0460 

B 

0 

1 

6 

0.98 

0.00 

0.72 

-0.18 

K0460 

C 

0 

1 

6 

-0.40 

0.00 

0.18 

-0.39 

K0460 

D 

0 

1 

6 

-0.05 

0.00 

0.26 

-0.34 

K0461 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0461 

A 

1 

10 

56 

1.51 

0.53 

1.26 

0.37 

K0461 

B 

0 

1 

6 

0.17 

0.00 

0.56 

-0.14 

K0461 

C 

0 

4 

22 

0.61 

0.32 

1.03 

-0.16 

K0461 

D 

0 

3 

17 

0.27 

0.97 

1.53 

-0.23 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0462 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0462 

A 

1 

15 

83 

1.91 

0.39 

0.58 

0.65 

K0462 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0462 

C 

0 

2 

11 

-1.04 

0.03 

0.21 

-0.50 

K0462 

D 

0 

1 

6 

-1.29 

0.00 

0.16 

-0.38 

K0463 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0463 

A 

1 

16 

89 

1.84 

0.34 

0.59 

0.60 

K0463 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0463 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0463 

D 

0 

2 

11 

-1.28 

1.09 

0.25 

-0.60 

K0464 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0464 

A 

1 

16 

89 

1.69 

0.40 

0.91 

0.65 

K0464 

B 

0 

1 

6 

-0.40 

0.00 

0.34 

-0.18 

K0464 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0464 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.71 

K0465 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.01 

K0465 

A 

1 

13 

68 

1.81 

0.51 

1.94 

0.48 

K0465 

B 

0 

3 

16 

0.60 

0.15 

0.97 

-0.15 

K0465 

C 

0 

2 

11 

-0.02 

0.53 

0.58 

-0.23 

K0465 

D 

0 

1 

5 

-2.24 

0.00 

0.06 

-0.45 

K0466 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0466 

A 

1 

15 

83 

2.37 

0.40 

0.76 

0.38 

K0466 

B 

0 

2 

11 

1.45 

2.09 

6.12 

-0.13 

K0466 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0466 

D 

0 

1 

6 

-1.13 

0.00 

0.11 

-0.45 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0467 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0467 

A 

1 

11 

61 

2.66 

0.50 

1.20 

0.52 

K0467 

B 

0 

3 

17 

-0.86 

2.10 

0.88 

-0.52 

K0467 

C 

0 

2 

11 

2.09 

0.32 

2.13 

0.06 

K0467 

D 

0 

2 

11 

0.20 

0.49 

0.35 

-0.24 

K0468 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.05 

K0468 

A 

1 

8 

44 

1.91 

0.69 

1.38 

0.45 

K0468 

B 

0 

4 

22 

1.05 

0.61 

1.73 

0.06 

K0468 

C 

0 

1 

6 

1.86 

0.00 

2.42 

0.12 

K0468 

D 

0 

5 

28 

-1.36 

1.05 

0.35 

-0.61 

K0469 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.01 

K0469 

A 

1 

12 

67 

1.54 

0.44 

1.03 

0.35 

K0469 

B 

0 

3 

17 

0.72 

0.76 

1.36 

-0.16 

K0469 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0469 

D 

0 

3 

17 

0.32 

0.06 

0.61 

-0.29 

K0470 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

K0470 

A 

1 

13 

68 

2.02 

0.49 

1.44 

0.47 

K0470 

B 

0 

4 

21 

1.09 

0.77 

2.31 

-0.05 

K0470 

C 

0 

1 

5 

-0.71 

0.00 

0.18 

-0.21 

K0470 

D 

0 

1 

5 

-4.92 

0.00 

0.00 

-0.66 

K0471 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0471 

A 

1 

17 

94 

2.00 

0.41 

0.57 

0.52 

K0471 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0471 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0471 

D 

0 

1 

6 

-2.24 

0.00 

0.09 

-0.52 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0472 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0472 

A 

1 

14 

78 

1.95 

0.37 

1.02 

0.36 

K0472 

B 

0 

2 

11 

1.37 

0.63 

1.41 

-0.09 

K0472 

C 

0 

1 

6 

0.11 

0.00 

0.33 

-0.29 

K0472 

D 

0 

1 

6 

0.39 

0.00 

0.44 

-0.24 

K0473 

* 

-1 

1299 

98 

1.39 

0.04 

0.00 

0.04 

K0473 

A 

1 

13 

65 

1.50 

0.37 

0.94 

0.45 

K0473 

B 

0 

5 

25 

0.85 

0.42 

1.37 

-0.03 

K0473 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0473 

D 

0 

2 

10 

-2.59 

1.47 

0.14 

-0.68 

K0474 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0474 

A 

1 

14 

78 

2.28 

0.25 

0.69 

0.69 

K0474 

B 

0 

2 

11 

0.38 

1.07 

0.57 

-0.43 

K0474 

C 

0 

2 

11 

0.22 

0.17 

0.30 

-0.48 

K0474 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0475 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0475 

A 

1 

12 

67 

1.75 

0.40 

0.71 

0.66 

K0475 

B 

0 

3 

17 

-0.62 

0.52 

0.38 

-0.47 

K0475 

C 

0 

2 

11 

0.19 

0.01 

0.68 

-0.19 

K0475 

D 

0 

1 

6 

-1.13 

0.00 

0.18 

-0.34 

K0476 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0476 

A 

1 

13 

72 

2.14 

0.46 

0.55 

0.61 

K0476 

B 

0 

1 

6 

2.46 

0.00 

6.55 

0.13 

K0476 

C 

0 

1 

6 

0.48 

0.00 

0.90 

-0.10 

K0476 

D 

0 

3 

17 

-2.27 

0.05 

0.06 

-0.75 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0477 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.06 

K0477 

A 

1 

12 

71 

1.49 

0.58 

1.09 

0.55 

K0477 

B 

0 

1 

6 

-0.56 

0.00 

0.47 

-0.13 

K0477 

C 

0 

2 

12 

-0.80 

0.33 

0.39 

-0.22 

K0477 

D 

0 

2 

12 

-2.31 

3.10 

1.81 

-0.46 

K0478 

* 

-1 

1204 

91 

1.38 

0.04 

0.00 

-0.01 

K0478 

A 

1 

67 

58 

1.84 

0.14 

1.12 

0.44 

K0478 

B 

0 

32 

28 

0.86 

0.14 

0.91 

-0.30 

K0478 

C 

0 

15 

13 

0.86 

0.24 

0.91 

-0.19 

K0478 

D 

0 

1 

1 

-0.89 

0.00 

0.11 

-0.19 

K0479 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0479 

A 

1 

14 

82 

1.43 

0.35 

1.42 

0.23 

K0479 

B 

0 

1 

6 

1.38 

0.00 

1.76 

0.02 

K0479 

C 

0 

1 

6 

1.81 

0.00 

2.71 

0.10 

K0479 

D 

0 

1 

6 

-1.29 

0.00 

0.12 

-0.49 

K0480 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.03 

K0480 

A 

1 

12 

63 

1.62 

0.32 

0.96 

0.63 

K0480 

B 

0 

5 

26 

-0.04 

0.49 

0.66 

-0.49 

K0480 

C 

0 

2 

11 

-0.01 

0.14 

0.43 

-0.28 

K0480 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0481 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

K0481 

A 

1 

16 

84 

1.63 

0.40 

0.83 

0.46 

K0481 

B 

0 

2 

11 

-0.57 

0.55 

0.38 

-0.39 

K0481 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0481 

D 

0 

1 

5 

-0.20 

0.00 

0.47 

-0.22 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0482 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.06 

K0482 

A 

1 

14 

88 

2.52 

0.34 

0.74 

0.57 

K0482 

B 

0 

2 

13 

0.13 

0.33 

0.28 

-0.57 

K0482 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0482 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0483 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0483 

A 

1 

14 

78 

2.26 

0.34 

0.89 

0.49 

K0483 

B 

0 

1 

6 

2.33 

0.00 

2.56 

0.08 

K0483 

C 

0 

2 

11 

-0.02 

0.13 

0.25 

-0.50 

K0483 

D 

0 

1 

6 

0.36 

0.00 

0.36 

-0.28 

K0484 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.07 

K0484 

A 

1 

12 

67 

1.84 

0.59 

1.13 

0.67 

K0484 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0484 

C 

0 

1 

6 

-0.62 

0.00 

0.47 

-0.10 

K0484 

D 

0 

5 

28 

-2.36 

1.19 

0.77 

-0.65 

K0485 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0485 

A 

1 

17 

94 

1.53 

0.39 

1.27 

-0.26 

K0485 

B 

0 

1 

6 

3.30 

0.00 

14.74 

0.26 

K0485 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0485 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0486 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

K0486 

A 

1 

12 

71 

2.49 

0.49 

0.60 

0.61 

K0486 

B 

0 

1 

6 

2.11 

0.00 

3.58 

0.05 

K0486 

C 

0 

3 

18 

-0.76 

0.88 

0.35 

-0.55 

K0486 

D 

0 

1 

6 

-1.14 

0.00 

0.14 

-0.35 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0487 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.05 

K0487 

A 

1 

10 

59 

2.19 

0.65 

2.81 

0.12 

K0487 

B 

0 

4 

24 

2.18 

0.22 

1.88 

0.05 

K0487 

C 

0 

2 

12 

1.98 

0.66 

1.74 

-0.01 

K0487 

D 

0 

1 

6 

-0.19 

0.00 

0.16 

-0.34 

K0488 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0488 

A 

-1 

17 

100 

1.96 

0.37 

0.00 

0.00 

K0488 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0488 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0488 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0489 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0489 

A 

1 

16 

89 

2.40 

0.36 

0.60 

0.61 

K0489 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0489 

C 

0 

1 

6 

0.16 

0.00 

0.46 

-0.26 

K0489 

D 

0 

1 

6 

-2.09 

0.00 

0.05 

-0.58 

K0490 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0490 

A 

1 

16 

89 

2.25 

0.50 

0.85 

0.38 

K0490 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0490 

C 

0 

1 

6 

1.76 

0.00 

4.26 

-0.02 

K0490 

D 

0 

1 

6 

-2.36 

0.00 

0.07 

-0.50 

K0491 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0491 

A 

1 

13 

72 

2.83 

0.36 

0.58 

0.76 

K0491 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0491 

C 

0 

4 

22 

-0.14 

0.37 

0.32 

-0.43 

K0491 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.71 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0492 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

K0492 

A 

1 

17 

89 

2.27 

0.43 

0.95 

0.42 

K0492 

B 

0 

1 

5 

0.19 

0.00 

0.64 

-0.24 

K0492 

C 

0 

1 

5 

-0.62 

0.00 

0.28 

-0.34 

K0492 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0493 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0493 

A 

1 

9 

50 

1.83 

0.77 

2.22 

0.36 

K0493 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0493 

C 

0 

7 

39 

0.81 

0.44 

2.84 

-0.15 

K0493 

D 

0 

2 

11 

-0.59 

0.30 

0.33 

-0.34 

K0494 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.05 

K0494 

A 

1 

7 

41 

1.56 

0.81 

1.61 

0.42 

K0494 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0494 

C 

0 

8 

47 

0.58 

0.29 

1.24 

-0.06 

K0494 

D 

0 

2 

12 

-1.87 

0.49 

0.10 

-0.54 

K0495 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0495 

A 

-1 

18 

100 

2.11 

0.43 

0.00 

0.00 

K0495 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0495 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0495 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0496 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

K0496 

A 

1 

14 

74 

2.52 

0.48 

0.84 

0.71 

K0496 

B 

0 

2 

11 

-0.92 

0.20 

0.21 

-0.32 

K0496 

C 

0 

2 

11 

-0.43 

1.23 

0.62 

-0.26 

K0496 

D 

0 

1 

5 

-4.92 

0.00 

0.00 

-0.60 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0497 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0497 

A 

1 

12 

71 

1.91 

0.27 

0.82 

0.55 

K0497 

B 

0 

1 

6 

1.66 

0.00 

1.35 

0.03 

K0497 

C 

0 

3 

18 

0.62 

0.41 

0.57 

-0.44 

K0497 

D 

0 

1 

6 

0.05 

0.00 

0.27 

-0.38 

K0498 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0498 

A 

1 

15 

83 

2.11 

0.39 

0.83 

0.43 

K0498 

B 

0 

1 

6 

-0.56 

0.00 

0.19 

-0.38 

K0498 

C 

0 

2 

11 

0.80 

0.61 

0.87 

-0.24 

K0498 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0499 

* 

-1 

1203 

91 

1.41 

0.04 

0.00 

0.05 

K0499 

A 

1 

83 

72 

1.29 

0.12 

1.17 

0.22 

K0499 

B 

0 

3 

3 

1.14 

0.20 

1.33 

0.00 

K0499 

C 

0 

28 

24 

0.80 

0.15 

1.22 

-0.17 

K0499 

D 

0 

2 

2 

-0.46 

1.75 

0.77 

-0.19 

K0500 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

K0500 

A 

1 

10 

59 

2.91 

0.37 

0.46 

0.74 

K0500 

B 

0 

1 

6 

2.77 

0.00 

3.63 

0.13 

K0500 

C 

0 

6 

35 

0.03 

0.25 

0.27 

-0.83 

K0500 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0501 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0501 

A 

1 

16 

89 

1.51 

0.44 

0.89 

0.33 

K0501 

B 

0 

1 

6 

0.06 

0.00 

0.66 

-0.17 

K0501 

C 

0 

1 

6 

-0.72 

0.00 

0.30 

-0.28 

K0501 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0502 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.01 

K0502 

A 

1 

17 

89 

1.75 

0.43 

1.07 

0.61 

K0502 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0502 

C 

0 

1 

5 

-0.88 

0.00 

0.32 

-0.23 

K0502 

D 

0 

1 

5 

-4.40 

0.00 

0.00 

-0.61 

K0503 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0503 

A 

1 

15 

83 

1.26 

0.43 

0.96 

0.36 

K0503 

B 

0 

1 

6 

-0.12 

0.00 

0.65 

-0.17 

K0503 

C 

0 

2 

11 

-0.36 

0.67 

0.63 

-0.30 

K0503 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0504 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0504 

A 

1 

10 

59 

2.45 

0.58 

1.62 

0.60 

K0504 

B 

0 

2 

12 

-3.33 

1.71 

0.06 

-0.70 

K0504 

C 

0 

5 

29 

0.69 

0.29 

0.77 

-0.15 

K0504 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0505 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0505 

A 

1 

11 

61 

1.68 

0.26 

0.52 

0.79 

K0505 

B 

0 

2 

11 

-0.15 

0.32 

0.43 

-0.29 

K0505 

C 

0 

3 

17 

-0.64 

0.54 

0.32 

-0.54 

K0505 

D 

0 

2 

11 

-0.18 

0.78 

0.53 

-0.30 

K0506 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.04 

K0506 

A 

1 

15 

83 

1.24 

0.30 

0.83 

0.57 

K0506 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0506 

C 

0 

2 

11 

-0.48 

0.54 

0.46 

-0.39 

K0506 

D 

0 

1 

6 

-1.14 

0.00 

0.21 

-0.39 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0507 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0507 

A 

1 

14 

78 

2.78 

0.46 

0.38 

0.77 

K0507 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0507 

C 

0 

1 

6 

-0.69 

0.00 

0.37 

-0.25 

K0507 

D 

0 

3 

17 

-1.95 

0.42 

0.12 

-0.71 

K0508 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0508 

A 

1 

15 

83 

2.07 

0.45 

1.25 

0.31 

K0508 

B 

0 

1 

6 

0.11 

0.00 

0.42 

-0.25 

K0508 

C 

0 

1 

6 

1.98 

0.00 

2.70 

0.02 

K0508 

D 

0 

1 

6 

-0.05 

0.00 

0.35 

-0.28 

K0509 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

K0509 

A 

1 

13 

76 

1.97 

0.44 

1.02 

0.36 

K0509 

B 

0 

1 

6 

1.15 

0.00 

1.08 

-0.08 

K0509 

C 

0 

2 

12 

1.37 

0.91 

1.94 

-0.07 

K0509 

D 

0 

1 

6 

-1.38 

0.00 

0.09 

-0.48 

K0510 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.06 

K0510 

A 

-1 

18 

100 

2.19 

0.46 

0.00 

0.00 

K0510 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0510 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0510 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0511 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.07 

K0511 

A 

1 

16 

89 

2.52 

0.30 

0.84 

0.47 

K0511 

B 

0 

1 

6 

0.71 

0.00 

0.35 

-0.31 

K0511 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0511 

D 

0 

1 

6 

0.61 

0.00 

0.32 

-0.33 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0512 

* 

-1 

1303 

99 

1.37 

0.04 

0.00 

-0.08 

K0512 

A 

1 

7 

44 

3.29 

0.56 

0.85 

0.54 

K0512 

B 

0 

1 

6 

3.73 

0.00 

4.92 

0.24 

K0512 

C 

0 

8 

50 

1.51 

0.29 

0.70 

-0.65 

K0512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0513 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0513 

A 

1 

15 

83 

2.05 

0.39 

0.75 

0.54 

K0513 

B 

0 

1 

6 

1.03 

0.00 

1.38 

-0.09 

K0513 

C 

0 

1 

6 

0.14 

0.00 

0.57 

-0.21 

K0513 

D 

0 

1 

6 

-2.49 

0.00 

0.04 

-0.58 

K0514 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

K0514 

A 

1 

14 

82 

1.37 

0.32 

1.51 

-0.34 

K0514 

B 

0 

2 

12 

1.76 

0.73 

2.45 

0.06 

K0514 

C 

0 

1 

6 

3.85 

0.00 

15.51 

0.46 

K0514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0515 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.06 

K0515 

A 

1 

17 

89 

2.32 

0.36 

0.96 

0.38 

K0515 

B 

0 

2 

11 

0.50 

0.44 

0.49 

-0.38 

K0515 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0516 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

K0516 

A 

1 

12 

71 

2.24 

0.37 

0.74 

0.64 

K0516 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0516 

C 

0 

3 

18 

0.28 

0.53 

0.55 

-0.42 

K0516 

D 

0 

2 

12 

-0.04 

1.03 

0.48 

-0.41 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0517 

* 

-1 

1303 

99 

1.39 

0.04 

0.00 

0.01 

K0517 

A 

1 

12 

75 

1.81 

0.37 

1.05 

0.53 

K0517 

B 

0 

2 

13 

1.35 

0.41 

1.33 

0.03 

K0517 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0517 

D 

0 

2 

13 

-2.61 

2.41 

0.26 

-0.72 

K0518 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0518 

A 

1 

13 

72 

1.46 

0.51 

1.85 

0.16 

K0518 

B 

0 

2 

11 

1.51 

0.57 

2.29 

0.05 

K0518 

C 

0 

2 

11 

0.53 

0.21 

0.75 

-0.18 

K0518 

D 

0 

1 

6 

0.39 

0.00 

0.64 

-0.14 

K0519 

* 

-1 

1300 

99 

1.39 

0.04 

0.00 

0.04 

K0519 

A 

1 

13 

68 

1.64 

0.36 

0.82 

0.61 

K0519 

B 

0 

1 

5 

1.00 

0.00 

1.31 

0.02 

K0519 

C 

0 

2 

11 

-0.61 

0.06 

0.26 

-0.25 

K0519 

D 

0 

3 

16 

-1.81 

1.81 

0.50 

-0.58 

K0520 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.02 

K0520 

A 

1 

14 

78 

1.26 

0.33 

1.38 

0.25 

K0520 

B 

0 

1 

6 

0.25 

0.00 

0.57 

-0.19 

K0520 

C 

0 

1 

6 

0.84 

0.00 

1.03 

-0.06 

K0520 

D 

0 

2 

11 

0.62 

0.37 

0.88 

-0.16 

K0521 

* 

-1 

1302 

99 

1.37 

0.04 

0.00 

-0.07 

K0521 

A 

1 

15 

88 

2.25 

0.41 

1.21 

-0.07 

K0521 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0521 

C 

0 

1 

6 

3.86 

0.00 

11.02 

0.26 

K0521 

D 

0 

1 

6 

1.30 

0.00 

0.85 

-0.16 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0522 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0522 

A 

1 

12 

67 

1.66 

0.41 

1.04 

0.41 

K0522 

B 

0 

2 

11 

0.11 

0.03 

0.43 

-0.34 

K0522 

C 

0 

4 

22 

0.82 

0.21 

0.93 

-0.21 

K0522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0523 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0523 

A 

1 

11 

61 

2.29 

0.55 

0.43 

0.74 

K0523 

B 

0 

1 

6 

-2.49 

0.00 

0.07 

-0.37 

K0523 

C 

0 

2 

11 

-1.34 

0.32 

0.24 

-0.36 

K0523 

D 

0 

4 

22 

-0.69 

0.60 

0.64 

-0.39 

K0524 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0524 

A 

1 

15 

83 

1.65 

0.53 

1.98 

0.36 

K0524 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0524 

C 

0 

2 

11 

1.47 

1.28 

6.53 

0.03 

K0524 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.62 

K0525 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

K0525 

A 

-1 

18 

100 

1.83 

0.37 

0.00 

0.00 

K0525 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0525 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0525 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0526 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0526 

A 

1 

13 

72 

1.73 

0.29 

0.96 

0.31 

K0526 

B 

0 

4 

22 

1.53 

0.45 

1.72 

0.01 

K0526 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0526 

D 

0 

1 

6 

-1.63 

0.00 

0.05 

-0.64 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0527 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0527 

A 

1 

16 

89 

1.96 

0.46 

1.05 

0.31 

K0527 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0527 

C 

0 

2 

11 

0.22 

0.02 

0.68 

-0.31 

K0527 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0528 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0528 

A 

1 

12 

67 

2.01 

0.47 

0.94 

0.39 

K0528 

B 

0 

1 

6 

0.19 

0.00 

0.41 

-0.23 

K0528 

C 

0 

3 

17 

0.52 

0.80 

0.88 

-0.32 

K0528 

D 

0 

2 

11 

1.44 

0.41 

1.53 

-0.04 

K0529 

* 

-1 

1300 

99 

1.37 

0.04 

0.00 

-0.05 

K0529 

A 

1 

12 

63 

2.67 

0.54 

1.30 

0.43 

K0529 

B 

0 

6 

32 

1.02 

0.75 

2.43 

-0.37 

K0529 

C 

0 

1 

5 

0.79 

0.00 

0.62 

-0.16 

K0529 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0530 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0530 

A 

1 

13 

72 

1.96 

0.61 

1.02 

0.47 

K0530 

B 

0 

4 

22 

-0.24 

0.20 

0.66 

-0.42 

K0530 

C 

0 

1 

6 

0.19 

0.00 

0.96 

-0.14 

K0530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0531 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

0.00 

K0531 

A 

1 

11 

58 

2.46 

0.62 

0.85 

0.59 

K0531 

B 

0 

3 

16 

-0.49 

0.72 

0.52 

-0.40 

K0531 

C 

0 

4 

21 

0.59 

0.67 

1.76 

-0.21 

K0531 

D 

0 

1 

5 

-0.88 

0.00 

0.21 

-0.26 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0532 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.07 

K0532 

A 

1 

13 

76 

1.24 

0.42 

1.13 

0.61 

K0532 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0532 

C 

0 

1 

6 

0.19 

0.00 

0.98 

-0.04 

K0532 

D 

0 

3 

18 

-2.49 

1.61 

0.51 

-0.65 

K0533 

* 

-1 

1302 

99 

1.39 

0.04 

0.00 

0.05 

K0533 

A 

1 

12 

71 

0.98 

0.22 

0.85 

0.33 

K0533 

B 

0 

1 

6 

-0.53 

0.00 

0.33 

-0.32 

K0533 

C 

0 

3 

18 

0.69 

1.13 

3.44 

-0.04 

K0533 

D 

0 

1 

6 

-0.20 

0.00 

0.46 

-0.24 

K0534 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.01 

K0534 

A 

1 

16 

89 

2.10 

0.28 

0.66 

0.80 

K0534 

B 

0 

1 

6 

-1.03 

0.00 

0.11 

-0.30 

K0534 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0534 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.79 

K0535 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.01 

K0535 

A 

1 

16 

89 

1.81 

0.39 

0.95 

0.66 

K0535 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0535 

C 

0 

1 

6 

-0.46 

0.00 

0.32 

-0.20 

K0535 

D 

0 

1 

6 

-4.92 

0.00 

0.00 

-0.70 

K0536 

* 

-1 

1206 

91 

1.39 

0.04 

0.00 

0.02 

K0536 

A 

1 

105 

93 

1.36 

0.13 

2.01 

0.24 

K0536 

B 

0 

3 

3 

0.47 

0.97 

2.28 

-0.09 

K0536 

C 

0 

5 

4 

-0.19 

0.25 

0.52 

-0.23 

K0536 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0537 

* 

-1 

1198 

91 

1.36 

0.04 

0.00 

-0.06 

K0537 

A 

1 

116 

96 

1.78 

0.11 

0.70 

0.48 

K0537 

B 

0 

1 

1 

-0.36 

0.00 

0.30 

-0.14 

K0537 

C 

0 

1 

1 

-2.42 

0.00 

0.04 

-0.28 

K0537 

D 

0 

3 

2 

-1.41 

0.82 

0.21 

-0.37 

K0538 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.02 

K0538 

A 

1 

16 

94 

1.81 

0.36 

0.95 

0.36 

K0538 

B 

0 

1 

6 

-0.46 

0.00 

0.30 

-0.36 

K0538 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0538 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0539 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0539 

A 

1 

10 

56 

2.43 

0.61 

1.58 

0.44 

K0539 

B 

0 

3 

17 

0.78 

1.41 

2.11 

-0.21 

K0539 

C 

0 

5 

28 

0.74 

0.57 

0.96 

-0.31 

K0539 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0540 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.03 

K0540 

A 

1 

18 

95 

1.78 

0.41 

1.16 

0.09 

K0540 

B 

0 

1 

5 

1.09 

0.00 

1.59 

-0.09 

K0540 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0540 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0541 

* 

-1 

1301 

99 

1.39 

0.04 

0.00 

0.03 

K0541 

A 

-1 

17 

94 

1.18 

0.33 

0.00 

0.60 

K0541 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0541 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0541 

D 

-1 

1 

6 

-2.99 

0.00 

0.00 

-0.60 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0542 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

K0542 

A 

1 

15 

83 

1.63 

0.36 

0.83 

0.36 

K0542 

B 

0 

1 

6 

1.01 

0.00 

1.33 

-0.05 

K0542 

C 

0 

1 

6 

2.11 

0.00 

3.96 

0.11 

K0542 

D 

0 

1 

6 

-2.94 

0.00 

0.03 

-0.65 

K0543 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.03 

K0543 

A 

1 

15 

83 

2.42 

0.52 

1.16 

0.61 

K0543 

B 

0 

1 

6 

-0.75 

0.00 

0.26 

-0.23 

K0543 

C 

0 

1 

6 

0.46 

0.00 

0.86 

-0.12 

K0543 

D 

0 

1 

6 

-5.12 

0.00 

0.00 

-0.65 

K0544 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

0.01 

K0544 

A 

1 

14 

82 

2.02 

0.35 

0.48 

0.80 

K0544 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0544 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0544 

D 

0 

3 

18 

-2.43 

0.89 

0.13 

-0.80 

K0545 

* 

-1 

1296 

98 

1.38 

0.04 

0.00 

-0.03 

K0545 

A 

1 

22 

96 

1.80 

0.35 

1.12 

0.10 

K0545 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0545 

C 

0 

1 

4 

1.04 

0.00 

1.36 

-0.10 

K0545 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0546 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.04 

K0546 

A 

1 

15 

94 

2.06 

0.53 

0.82 

0.37 

K0546 

B 

0 

1 

6 

-1.09 

0.00 

0.25 

-0.37 

K0546 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0546 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0547 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.04 

K0547 

A 

1 

8 

42 

3.07 

0.67 

1.49 

0.57 

K0547 

B 

0 

3 

16 

-0.29 

0.70 

0.27 

-0.50 

K0547 

C 

0 

8 

42 

1.37 

0.41 

1.31 

-0.21 

K0547 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0548 

* 

-1 

1299 

98 

1.38 

0.04 

0.00 

-0.02 

K0548 

A 

1 

14 

70 

1.81 

0.47 

1.59 

0.17 

K0548 

B 

0 

2 

10 

1.46 

0.73 

1.73 

-0.04 

K0548 

C 

0 

4 

20 

1.13 

0.68 

1.89 

-0.16 

K0548 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0549 

* 

-1 

1301 

99 

1.37 

0.04 

0.00 

-0.05 

K0549 

A 

1 

16 

89 

2.16 

0.32 

0.81 

0.41 

K0549 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0549 

C 

0 

1 

6 

1.86 

0.00 

1.85 

-0.02 

K0549 

D 

0 

1 

6 

-1.12 

0.00 

0.09 

-0.54 

K0550 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

K0550 

A 

1 

17 

94 

1.80 

0.33 

0.80 

0.46 

K0550 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0550 

C 

0 

1 

6 

-1.12 

0.00 

0.15 

-0.46 

K0550 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCCll 

* 

-1 

1221 

93 

1.37 

0.04 

0.00 

-0.02 

KCCll 

A 

1 

82 

84 

1.76 

0.13 

0.86 

0.44 

KCCll 

B 

0 

5 

5 

-0.31 

0.29 

0.29 

-0.34 

KCCll 

C 

0 

11 

11 

0.54 

0.27 

0.92 

-0.28 

KCCll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCCllO 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.02 

KCCllO 

A 

1 

46 

90 

1.75 

0.16 

0.79 

0.48 

KCCllO 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCCllO 

C 

0 

5 

10 

-0.18 

0.15 

0.29 

-0.48 

KCCllO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCClll 

* 

-1 

1268 

96 

1.40 

0.04 

0.00 

0.06 

KCClll 

A 

1 

42 

82 

1.04 

0.19 

1.00 

0.26 

KCClll 

B 

0 

7 

14 

0.23 

0.27 

0.86 

-0.23 

KCClll 

C 

0 

2 

4 

0.36 

0.66 

0.99 

-0.09 

KCClll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC112 

* 

-1 

1217 

92 

1.38 

0.04 

0.00 

-0.01 

KCC112 

A 

1 

83 

81 

1.69 

0.11 

0.92 

0.49 

KCC112 

B 

0 

12 

12 

0.21 

0.23 

0.55 

-0.39 

KCC112 

C 

0 

7 

7 

0.36 

0.27 

0.58 

-0.26 

KCC112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC113 

* 

-1 

1264 

96 

1.40 

0.04 

0.00 

0.07 

KCC113 

A 

1 

40 

73 

1.16 

0.17 

0.95 

0.40 

KCC113 

B 

0 

10 

18 

0.48 

0.36 

1.88 

-0.16 

KCC113 

C 

0 

5 

9 

-0.55 

0.41 

0.41 

-0.39 

KCC113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC114 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KCC114 

A 

1 

34 

67 

1.89 

0.27 

1.13 

0.40 

KCC114 

B 

0 

10 

20 

0.72 

0.20 

0.81 

-0.25 

KCC114 

C 

0 

7 

14 

0.55 

0.44 

0.91 

-0.25 

KCC114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC115 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC115 

A 

1 

40 

80 

0.99 

0.13 

1.13 

0.15 

KCC115 

B 

0 

7 

14 

0.54 

0.24 

0.95 

-0.19 

KCC115 

C 

0 

3 

6 

1.00 

0.80 

2.47 

0.02 

KCC115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC116 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

KCC116 

A 

1 

30 

61 

1.37 

0.18 

1.04 

0.34 

KCC116 

B 

0 

13 

27 

0.64 

0.29 

1.18 

-0.27 

KCC116 

C 

0 

6 

12 

0.72 

0.25 

0.91 

-0.14 

KCC116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC117 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.03 

KCC117 

A 

1 

38 

75 

1.52 

0.19 

0.94 

0.50 

KCC117 

B 

0 

6 

12 

0.30 

0.23 

0.63 

-0.26 

KCC117 

C 

0 

7 

14 

0.02 

0.30 

0.58 

-0.38 

KCC117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC118 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC118 

A 

1 

41 

80 

1.87 

0.14 

0.77 

0.57 

KCC118 

B 

0 

4 

8 

0.99 

0.28 

0.85 

-0.16 

KCC118 

C 

0 

6 

12 

-0.09 

0.31 

0.33 

-0.57 

KCC118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC119 

* 

-1 

1267 

96 

1.39 

0.04 

0.00 

0.01 

KCC119 

A 

1 

40 

77 

1.52 

0.17 

0.99 

0.38 

KCC119 

B 

0 

7 

13 

0.68 

0.41 

1.13 

-0.21 

KCC119 

C 

0 

5 

10 

0.21 

0.42 

0.62 

-0.30 

KCC119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC12 

* 

-1 

1268 

96 

1.37 

0.04 

0.00 

-0.04 

KCC12 

A 

1 

46 

90 

1.77 

0.17 

1.54 

0.27 

KCC12 

B 

0 

2 

4 

1.32 

0.45 

1.33 

-0.06 

KCC12 

C 

0 

3 

6 

0.23 

0.77 

0.76 

-0.30 

KCC12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC120 

* 

-1 

1264 

96 

1.36 

0.04 

0.00 

-0.06 

KCC120 

A 

1 

48 

87 

1.98 

0.16 

0.87 

0.41 

KCC120 

B 

0 

4 

7 

0.35 

0.54 

0.53 

-0.35 

KCC120 

C 

0 

3 

5 

0.84 

0.38 

0.68 

-0.20 

KCC120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC121 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC121 

A 

1 

30 

61 

1.47 

0.22 

1.17 

0.36 

KCC121 

B 

0 

10 

20 

0.60 

0.30 

0.98 

-0.25 

KCC121 

C 

0 

9 

18 

0.70 

0.23 

0.93 

-0.19 

KCC121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC122 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.01 

KCC122 

A 

1 

38 

76 

1.76 

0.19 

0.94 

0.43 

KCC122 

B 

0 

6 

12 

0.57 

0.35 

0.74 

-0.29 

KCC122 

C 

0 

6 

12 

0.61 

0.28 

0.76 

-0.27 

KCC122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC13 

* 

-1 

1266 

96 

1.38 

0.04 

0.00 

0.00 

KCC13 

A 

1 

36 

68 

1.65 

0.15 

0.94 

0.40 

KCC13 

B 

0 

8 

15 

0.63 

0.23 

0.63 

-0.36 

KCC13 

C 

0 

9 

17 

1.10 

0.27 

1.18 

-0.15 

KCC13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC14 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC14 

A 

1 

41 

85 

1.64 

0.20 

1.13 

0.31 

KCC14 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC14 

C 

0 

7 

15 

0.51 

0.23 

0.75 

-0.31 

KCC14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC15 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.02 

KCC15 

A 

1 

39 

76 

1.74 

0.20 

1.07 

0.28 

KCC15 

B 

0 

4 

8 

0.59 

0.35 

0.61 

-0.24 

KCC15 

C 

0 

8 

16 

1.15 

0.30 

1.24 

-0.15 

KCC15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC16 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC16 

A 

1 

40 

80 

1.11 

0.19 

0.98 

0.32 

KCC16 

B 

0 

9 

18 

0.28 

0.17 

0.83 

-0.26 

KCC16 

C 

0 

1 

2 

-0.89 

0.00 

0.23 

-0.22 

KCC16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC17 

* 

-1 

1265 

96 

1.40 

0.04 

0.00 

0.07 

KCC17 

A 

1 

42 

78 

1.18 

0.17 

0.90 

0.47 

KCC17 

B 

0 

3 

6 

-0.72 

0.26 

0.30 

-0.33 

KCC17 

C 

0 

9 

17 

0.04 

0.29 

0.77 

-0.32 

KCC17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC18 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KCC18 

A 

1 

45 

88 

1.66 

0.22 

0.94 

0.34 

KCC18 

B 

0 

5 

10 

0.00 

0.43 

0.56 

-0.33 

KCC18 

C 

0 

1 

2 

0.60 

0.00 

0.79 

-0.08 

KCC18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC19 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC19 

A 

1 

48 

96 

0.98 

0.11 

0.93 

0.33 

KCC19 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC19 

C 

0 

2 

4 

-0.38 

0.86 

0.51 

-0.33 

KCC19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC21 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

KCC21 

A 

1 

34 

69 

1.40 

0.16 

0.92 

0.46 

KCC21 

B 

0 

5 

10 

-0.01 

0.40 

0.53 

-0.37 

KCC21 

C 

0 

10 

20 

0.61 

0.21 

0.92 

-0.25 

KCC21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC22 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.02 

KCC22 

A 

1 

42 

84 

1.45 

0.16 

0.80 

0.46 

KCC22 

B 

0 

3 

6 

-0.43 

0.11 

0.29 

-0.35 

KCC22 

C 

0 

5 

10 

0.22 

0.56 

1.11 

-0.28 

KCC22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC23 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC23 

A 

1 

45 

88 

1.72 

0.16 

1.03 

0.38 

KCC23 

B 

0 

3 

6 

0.79 

0.17 

0.69 

-0.18 

KCC23 

C 

0 

3 

6 

0.11 

0.26 

0.36 

-0.34 

KCC23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC24 

* 

-1 

1267 

96 

1.39 

0.04 

0.00 

0.01 

KCC24 

A 

1 

35 

67 

1.48 

0.20 

1.29 

0.25 

KCC24 

B 

0 

8 

15 

0.75 

0.33 

0.96 

-0.20 

KCC24 

C 

0 

9 

17 

0.97 

0.35 

1.35 

-0.12 

KCC24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC31 

* 

-1 

1268 

96 

1.37 

0.04 

0.00 

-0.04 

KCC31 

A 

1 

41 

80 

1.81 

0.19 

2.00 

0.25 

KCC31 

B 

0 

3 

6 

1.80 

0.28 

1.77 

0.03 

KCC31 

C 

0 

7 

14 

0.72 

0.32 

0.74 

-0.31 

KCC31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC310 

* 

-1 

1264 

96 

1.36 

0.04 

0.00 

-0.06 

KCC310 

A 

1 

40 

73 

2.01 

0.19 

1.16 

0.29 

KCC310 

B 

0 

5 

9 

1.35 

0.24 

0.93 

-0.12 

KCC310 

C 

0 

10 

18 

1.20 

0.35 

1.40 

-0.24 

KCC310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC311 

* 

-1 

1223 

93 

1.39 

0.04 

0.00 

0.02 

KCC311 

A 

1 

86 

90 

1.47 

0.12 

0.87 

0.45 

KCC311 

B 

0 

2 

2 

-0.36 

0.67 

0.37 

-0.21 

KCC311 

C 

0 

8 

8 

-0.20 

0.11 

0.37 

-0.39 

KCC311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC312 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC312 

A 

1 

38 

78 

1.30 

0.19 

1.14 

0.24 

KCC312 

B 

0 

8 

16 

0.73 

0.26 

1.13 

-0.17 

KCC312 

C 

0 

3 

6 

0.43 

0.74 

1.16 

-0.16 

KCC312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC313 

* 

-1 

1221 

93 

1.39 

0.04 

0.00 

0.03 

KCC313 

A 

1 

91 

93 

1.34 

0.12 

0.92 

0.30 

KCC313 

B 

0 

7 

7 

-0.10 

0.32 

0.54 

-0.30 

KCC313 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC314 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.01 

KCC314 

A 

1 

24 

48 

1.92 

0.28 

1.30 

0.36 

KCC314 

B 

0 

3 

6 

0.38 

0.19 

0.39 

-0.24 

KCC314 

C 

0 

23 

46 

1.17 

0.17 

1.06 

-0.24 

KCC314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC315 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KCC315 

A 

1 

48 

92 

1.50 

0.13 

0.92 

0.37 

KCC315 

B 

0 

2 

4 

0.02 

0.55 

0.40 

-0.30 

KCC315 

C 

0 

2 

4 

0.42 

0.32 

0.54 

-0.21 

KCC315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC316 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC316 

A 

1 

46 

96 

1.56 

0.18 

0.96 

0.30 

KCC316 

B 

0 

1 

2 

-0.14 

0.00 

0.38 

-0.18 

KCC316 

C 

0 

1 

2 

-0.59 

0.00 

0.24 

-0.24 

KCC316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC317 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.02 

KCC317 

A 

1 

45 

88 

1.65 

0.18 

1.00 

0.20 

KCC317 

B 

0 

3 

6 

0.73 

0.95 

1.59 

-0.17 

KCC317 

C 

0 

3 

6 

1.05 

0.28 

1.00 

-0.11 

KCC317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC318 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC318 

A 

1 

41 

82 

1.06 

0.19 

0.98 

0.25 

KCC318 

B 

0 

4 

8 

0.26 

0.52 

1.10 

-0.17 

KCC318 

C 

0 

5 

10 

0.31 

0.36 

0.95 

-0.18 

KCC318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC319 

* 

-1 

1267 

96 

1.40 

0.04 

0.00 

0.06 

KCC319 

A 

1 

30 

58 

1.26 

0.20 

0.99 

0.36 

KCC319 

B 

0 

10 

19 

0.05 

0.35 

0.82 

-0.35 

KCC319 

C 

0 

12 

23 

0.72 

0.32 

1.74 

-0.08 

KCC319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC32 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KCC32 

A 

1 

50 

98 

1.54 

0.20 

0.85 

0.30 

KCC32 

B 

0 

1 

2 

-1.67 

0.00 

0.10 

-0.30 

KCC32 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC320 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC320 

A 

1 

38 

76 

1.11 

0.12 

0.90 

0.40 

KCC320 

B 

0 

2 

4 

0.78 

0.65 

1.22 

-0.04 

KCC320 

C 

0 

10 

20 

0.27 

0.28 

0.82 

-0.40 

KCC320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC321 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

KCC321 

A 

1 

38 

78 

1.24 

0.16 

1.05 

0.25 

KCC321 

B 

0 

6 

12 

0.46 

0.41 

0.94 

-0.24 

KCC321 

C 

0 

5 

10 

0.82 

0.37 

1.34 

-0.09 

KCC321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC322 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.02 

KCC322 

A 

1 

47 

94 

1.30 

0.17 

0.98 

0.28 

KCC322 

B 

0 

1 

2 

0.39 

0.00 

0.72 

-0.10 

KCC322 

C 

0 

2 

4 

-0.33 

0.10 

0.35 

-0.27 

KCC322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC33 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC33 

A 

1 

41 

80 

1.77 

0.16 

1.06 

0.37 

KCC33 

B 

0 

4 

8 

0.55 

0.40 

0.59 

-0.28 

KCC33 

C 

0 

6 

12 

0.94 

0.39 

1.07 

-0.22 

KCC33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC34 

* 

-1 

1267 

96 

1.39 

0.04 

0.00 

0.01 

KCC34 

A 

1 

38 

73 

1.57 

0.17 

0.91 

0.41 

KCC34 

B 

0 

10 

19 

0.68 

0.35 

1.13 

-0.26 

KCC34 

C 

0 

4 

8 

0.08 

0.53 

0.56 

-0.30 

KCC34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC35 

* 

-1 

1268 

96 

1.37 

0.04 

0.00 

-0.04 

KCC35 

A 

1 

44 

86 

1.87 

0.15 

0.79 

0.44 

KCC35 

B 

0 

4 

8 

1.26 

0.66 

1.82 

-0.10 

KCC35 

C 

0 

3 

6 

-0.88 

0.85 

0.22 

-0.53 

KCC35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC36 

* 

-1 

1264 

96 

1.36 

0.04 

0.00 

-0.06 

KCC36 

A 

1 

50 

91 

1.83 

0.15 

0.98 

0.07 

KCC36 

B 

0 

1 

2 

4.26 

0.00 

18.74 

0.29 

KCC36 

C 

0 

4 

7 

0.85 

0.79 

1.57 

-0.23 

KCC36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC37 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC37 

A 

1 

43 

88 

1.19 

0.18 

1.12 

0.09 

KCC37 

B 

0 

4 

8 

0.89 

0.48 

1.67 

-0.07 

KCC37 

C 

0 

2 

4 

0.83 

1.01 

1.72 

-0.06 

KCC37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC38 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KCC38 

A 

1 

39 

83 

1.61 

0.19 

0.96 

0.31 

KCC38 

B 

0 

5 

11 

0.66 

0.31 

0.82 

-0.23 

KCC38 

C 

0 

3 

6 

0.64 

0.94 

1.48 

-0.18 

KCC38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC39 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KCC39 

A 

1 

44 

85 

1.55 

0.13 

0.91 

0.38 

KCC39 

B 

0 

1 

2 

0.42 

0.00 

0.48 

-0.15 

KCC39 

C 

0 

7 

13 

0.60 

0.32 

0.80 

-0.35 

KCC39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC41 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC41 

A 

1 

33 

69 

1.77 

0.22 

1.22 

0.34 

KCC41 

B 

0 

9 

19 

1.26 

0.41 

2.39 

-0.08 

KCC41 

C 

0 

6 

13 

0.19 

0.31 

0.46 

-0.38 

KCC41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC42 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KCC42 

A 

1 

47 

94 

1.62 

0.17 

0.95 

0.23 

KCC42 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC42 

C 

0 

3 

6 

0.47 

0.71 

0.89 

-0.23 

KCC42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC43 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC43 

A 

1 

44 

88 

1.04 

0.18 

0.93 

0.28 

KCC43 

B 

0 

1 

2 

-0.30 

0.00 

0.43 

-0.15 

KCC43 

C 

0 

5 

10 

0.11 

0.44 

0.94 

-0.23 

KCC43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC44 

* 

-1 

1268 

96 

1.40 

0.04 

0.00 

0.07 

KCC44 

A 

1 

33 

65 

1.25 

0.20 

0.94 

0.44 

KCC44 

B 

0 

10 

20 

0.16 

0.22 

0.70 

-0.30 

KCC44 

C 

0 

8 

16 

0.22 

0.44 

1.04 

-0.24 

KCC44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC51 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.01 

KCC51 

A 

1 

42 

84 

1.72 

0.23 

1.05 

0.39 

KCC51 

B 

0 

4 

8 

0.31 

0.45 

0.81 

-0.23 

KCC51 

C 

0 

4 

8 

-0.04 

0.34 

0.47 

-0.30 

KCC51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC510 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC510 

A 

1 

45 

90 

1.00 

0.12 

1.05 

0.24 

KCC510 

B 

0 

1 

2 

0.47 

0.00 

0.81 

-0.08 

KCC510 

C 

0 

4 

8 

0.31 

0.29 

0.76 

-0.23 

KCC510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC511 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.04 

KCC511 

A 

1 

46 

94 

1.18 

0.14 

0.94 

0.31 

KCC511 

B 

0 

2 

4 

0.39 

0.00 

0.75 

-0.14 

KCC511 

C 

0 

1 

2 

-1.14 

0.00 

0.16 

-0.32 

KCC511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC512 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.02 

KCC512 

A 

1 

38 

76 

1.41 

0.19 

0.96 

0.30 

KCC512 

B 

0 

7 

14 

0.77 

0.33 

1.16 

-0.15 

KCC512 

C 

0 

5 

10 

0.34 

0.65 

1.39 

-0.25 

KCC512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC513 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC513 

A 

1 

45 

88 

1.71 

0.15 

0.91 

0.35 

KCC513 

B 

0 

3 

6 

0.67 

1.00 

1.44 

-0.21 

KCC513 

C 

0 

3 

6 

0.40 

0.51 

0.57 

-0.27 

KCC513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC514 

* 

-1 

1267 

96 

1.39 

0.04 

0.00 

0.01 

KCC514 

A 

1 

43 

83 

1.42 

0.18 

1.12 

0.27 

KCC514 

B 

0 

8 

15 

0.85 

0.23 

1.15 

-0.16 

KCC514 

C 

0 

1 

2 

-1.28 

0.00 

0.11 

-0.31 

KCC514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC515 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

KCC515 

A 

1 

47 

96 

1.75 

0.16 

0.76 

0.37 

KCC515 

B 

0 

1 

2 

-2.42 

0.00 

0.04 

-0.48 

KCC515 

C 

0 

1 

2 

1.29 

0.00 

1.45 

-0.04 

KCC515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC516 

* 

-1 

1221 

93 

1.40 

0.04 

0.00 

0.04 

KCC516 

A 

1 

93 

95 

1.18 

0.11 

1.03 

0.12 

KCC516 

B 

0 

1 

1 

0.06 

0.00 

0.53 

-0.10 

KCC516 

C 

0 

4 

4 

0.69 

0.64 

1.97 

-0.09 

KCC516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC517 

* 

-1 

1266 

96 

1.36 

0.04 

0.00 

-0.06 

KCC517 

A 

1 

47 

89 

1.90 

0.17 

1.08 

0.19 

KCC517 

B 

0 

1 

2 

1.32 

0.00 

0.94 

-0.06 

KCC517 

C 

0 

5 

9 

1.19 

0.49 

1.21 

-0.18 

KCC517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC518 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC518 

A 

1 

39 

80 

1.30 

0.18 

1.02 

0.25 

KCC518 

B 

0 

4 

8 

0.45 

0.65 

1.20 

-0.19 

KCC518 

C 

0 

6 

12 

0.68 

0.41 

1.28 

-0.16 

KCC518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC519 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KCC519 

A 

1 

29 

62 

1.68 

0.24 

1.21 

0.26 

KCC519 

B 

0 

4 

9 

0.93 

0.79 

1.61 

-0.13 

KCC519 

C 

0 

14 

30 

1.09 

0.17 

1.02 

-0.20 

KCC519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC52 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KCC52 

A 

1 

25 

48 

1.73 

0.20 

1.07 

0.34 

KCC52 

B 

0 

26 

50 

1.13 

0.15 

1.00 

-0.30 

KCC52 

C 

0 

1 

2 

0.47 

0.00 

0.40 

-0.14 

KCC52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC520 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC520 

A 

1 

28 

58 

1.96 

0.22 

1.04 

0.45 

KCC520 

B 

0 

6 

13 

0.66 

0.51 

0.82 

-0.24 

KCC520 

C 

0 

14 

29 

0.86 

0.30 

1.42 

-0.31 

KCC520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC521 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KCC521 

A 

1 

48 

96 

1.62 

0.17 

0.98 

0.25 

KCC521 

B 

0 

1 

2 

0.10 

0.00 

0.39 

-0.17 

KCC521 

C 

0 

1 

2 

0.10 

0.00 

0.39 

-0.17 

KCC521 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC522 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC522 

A 

1 

40 

80 

1.10 

0.18 

0.91 

0.32 

KCC522 

B 

0 

7 

14 

0.21 

0.32 

0.92 

-0.25 

KCC522 

C 

0 

3 

6 

0.12 

0.75 

1.13 

-0.17 

KCC522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC53 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC53 

A 

1 

20 

40 

1.43 

0.28 

1.05 

0.37 

KCC53 

B 

0 

7 

14 

0.23 

0.33 

0.68 

-0.24 

KCC53 

C 

0 

23 

46 

0.68 

0.21 

1.07 

-0.19 

KCC53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC54 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KCC54 

A 

1 

39 

80 

1.83 

0.23 

0.83 

0.45 

KCC54 

B 

0 

9 

18 

0.16 

0.35 

0.68 

-0.42 

KCC54 

C 

0 

1 

2 

0.23 

0.00 

0.48 

-0.12 

KCC54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC55 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KCC55 

A 

1 

47 

98 

1.02 

0.11 

0.93 

0.36 

KCC55 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC55 

C 

0 

1 

2 

-0.91 

0.00 

0.20 

-0.36 

KCC55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC56 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KCC56 

A 

1 

46 

96 

1.06 

0.14 

1.05 

0.08 

KCC56 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC56 

C 

0 

2 

4 

0.66 

0.27 

1.03 

-0.08 

KCC56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC57 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

-0.01 

KCC57 

A 

1 

81 

81 

1.58 

0.12 

1.02 

0.27 

KCC57 

B 

0 

14 

14 

0.67 

0.26 

1.00 

-0.28 

KCC57 

C 

0 

5 

5 

1.27 

0.66 

3.04 

-0.03 

KCC57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC58 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KCC58 

A 

1 

40 

83 

1.33 

0.17 

0.91 

0.35 

KCC58 

B 

0 

3 

6 

0.28 

0.50 

0.74 

-0.20 

KCC58 

C 

0 

5 

10 

0.22 

0.56 

1.13 

-0.28 

KCC58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC59 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC59 

A 

1 

45 

88 

1.75 

0.14 

0.86 

0.45 

KCC59 

B 

0 

1 

2 

-0.93 

0.00 

0.12 

-0.33 

KCC59 

C 

0 

5 

10 

0.51 

0.42 

0.71 

-0.33 

KCC59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC61 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KCC61 

A 

1 

23 

45 

1.62 

0.23 

1.22 

0.27 

KCC61 

B 

0 

17 

33 

1.02 

0.34 

1.76 

-0.16 

KCC61 

C 

0 

11 

22 

0.93 

0.17 

0.79 

-0.15 

KCC61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC62 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

KCC62 

A 

1 

44 

90 

1.86 

0.16 

0.78 

0.50 

KCC62 

B 

0 

2 

4 

0.50 

0.00 

0.53 

-0.19 

KCC62 

C 

0 

3 

6 

-0.61 

1.07 

0.45 

-0.47 

KCC62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC63 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KCC63 

A 

1 

46 

88 

1.95 

0.17 

0.95 

0.29 

KCC63 

B 

0 

4 

8 

0.44 

0.53 

0.58 

-0.34 

KCC63 

C 

0 

2 

4 

1.77 

0.83 

2.00 

-0.01 

KCC63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC64 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC64 

A 

1 

46 

94 

1.22 

0.17 

1.02 

0.23 

KCC64 

B 

0 

1 

2 

-0.02 

0.00 

0.50 

-0.15 

KCC64 

C 

0 

2 

4 

0.22 

0.08 

0.65 

-0.17 

KCC64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC71 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KCC71 

A 

1 

30 

64 

1.68 

0.24 

1.25 

0.27 

KCC71 

B 

0 

8 

17 

1.22 

0.35 

1.54 

-0.08 

KCC71 

C 

0 

9 

19 

0.85 

0.23 

0.84 

-0.25 

KCC71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC710 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KCC710 

A 

1 

46 

88 

1.51 

0.14 

0.98 

0.33 

KCC710 

B 

0 

1 

2 

0.42 

0.00 

0.49 

-0.15 

KCC710 

C 

0 

5 

10 

0.58 

0.15 

0.61 

-0.29 

KCC710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC711 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC711 

A 

1 

39 

81 

1.74 

0.20 

0.99 

0.43 

KCC711 

B 

0 

3 

6 

0.12 

0.60 

0.53 

-0.28 

KCC711 

C 

0 

6 

13 

0.43 

0.27 

0.67 

-0.31 

KCC711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC712 

* 

-1 

1217 

92 

1.35 

0.04 

0.00 

-0.07 

KCC712 

A 

1 

82 

80 

2.00 

0.12 

0.91 

0.44 

KCC712 

B 

0 

11 

11 

0.38 

0.35 

0.54 

-0.40 

KCC712 

C 

0 

9 

9 

1.04 

0.29 

0.93 

-0.18 

KCC712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC713 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KCC713 

A 

1 

36 

72 

1.81 

0.21 

1.08 

0.34 

KCC713 

B 

0 

9 

18 

0.67 

0.21 

0.65 

-0.34 

KCC713 

C 

0 

5 

10 

1.32 

0.27 

1.25 

-0.07 

KCC713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC714 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC714 

A 

1 

32 

64 

1.29 

0.22 

0.93 

0.42 

KCC714 

B 

0 

2 

4 

-0.11 

0.79 

0.59 

-0.18 

KCC714 

C 

0 

16 

32 

0.31 

0.15 

0.80 

-0.36 

KCC714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC715 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC715 

A 

1 

32 

64 

1.39 

0.18 

0.80 

0.56 

KCC715 

B 

0 

11 

22 

-0.07 

0.26 

0.58 

-0.46 

KCC715 

C 

0 

7 

14 

0.28 

0.26 

0.76 

-0.22 

KCC715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC716 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KCC716 

A 

1 

40 

82 

1.81 

0.23 

0.85 

0.45 

KCC716 

B 

0 

6 

12 

-0.05 

0.38 

0.50 

-0.39 

KCC716 

C 

0 

3 

6 

0.37 

0.55 

0.74 

-0.19 

KCC716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC717 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KCC717 

A 

1 

22 

46 

0.91 

0.18 

1.45 

-0.08 

KCC717 

B 

0 

9 

19 

1.02 

0.18 

1.17 

0.02 

KCC717 

C 

0 

17 

35 

1.04 

0.20 

1.47 

0.07 

KCC717 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC718 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KCC718 

A 

1 

34 

71 

1.33 

0.15 

0.88 

0.48 

KCC718 

B 

0 

1 

2 

-0.11 

0.00 

0.37 

-0.18 

KCC718 

C 

0 

13 

27 

0.38 

0.22 

0.77 

-0.43 

KCC718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC719 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KCC719 

A 

1 

30 

63 

1.52 

0.21 

0.94 

0.42 

KCC719 

B 

0 

7 

15 

0.69 

0.41 

1.15 

-0.17 

KCC719 

C 

0 

11 

23 

0.42 

0.19 

0.68 

-0.35 

KCC719 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC72 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KCC72 

A 

1 

33 

65 

1.92 

0.16 

0.89 

0.44 

KCC72 

B 

0 

16 

31 

0.93 

0.28 

1.06 

-0.41 

KCC72 

C 

0 

2 

4 

1.06 

0.09 

0.69 

-0.10 

KCC72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC720 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KCC720 

A 

1 

30 

59 

1.70 

0.21 

1.09 

0.44 

KCC720 

B 

0 

3 

6 

0.03 

0.74 

0.52 

-0.27 

KCC720 

C 

0 

18 

35 

0.77 

0.19 

0.91 

-0.32 

KCC720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC721 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

KCC721 

A 

1 

39 

80 

1.96 

0.16 

0.80 

0.49 

KCC721 

B 

0 

3 

6 

0.78 

0.37 

0.68 

-0.18 

KCC721 

C 

0 

7 

14 

0.34 

0.61 

0.81 

-0.44 

KCC721 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC722 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KCC722 

A 

1 

37 

71 

2.15 

0.18 

0.90 

0.44 

KCC722 

B 

0 

6 

12 

0.68 

0.31 

0.49 

-0.36 

KCC722 

C 

0 

9 

17 

1.27 

0.33 

1.07 

-0.22 

KCC722 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC73 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KCC73 

A 

1 

43 

88 

1.28 

0.17 

1.03 

0.31 

KCC73 

B 

0 

5 

10 

0.32 

0.27 

0.80 

-0.25 

KCC73 

C 

0 

1 

2 

-0.35 

0.00 

0.34 

-0.19 

KCC73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC74 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KCC74 

A 

1 

34 

72 

1.74 

0.21 

1.05 

0.41 

KCC74 

B 

0 

2 

4 

0.25 

0.24 

0.42 

-0.21 

KCC74 

C 

0 

11 

23 

0.74 

0.20 

0.83 

-0.33 

KCC74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC75 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KCC75 

A 

1 

43 

83 

1.51 

0.14 

0.99 

0.26 

KCC75 

B 

0 

6 

12 

0.99 

0.41 

1.23 

-0.16 

KCC75 

C 

0 

3 

6 

0.63 

0.14 

0.60 

-0.21 

KCC75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KCC76 

* 

-1 

1219 

92 

1.42 

0.04 

0.00 

0.09 

KCC76 

A 

1 

64 

64 

1.30 

0.15 

0.92 

0.44 

KCC76 

B 

0 

22 

22 

0.36 

0.12 

0.81 

-0.26 

KCC76 

C 

0 

14 

14 

0.05 

0.26 

0.76 

-0.30 

KCC76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC77 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KCC77 

A 

1 

27 

56 

2.08 

0.25 

1.26 

0.53 

KCC77 

B 

0 

13 

27 

0.80 

0.26 

0.83 

-0.32 

KCC77 

C 

0 

8 

17 

0.55 

0.19 

0.49 

-0.32 

KCC77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC78 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KCC78 

A 

1 

30 

60 

1.96 

0.23 

0.96 

0.41 

KCC78 

B 

0 

11 

22 

1.12 

0.20 

0.96 

-0.19 

KCC78 

C 

0 

9 

18 

0.74 

0.32 

0.79 

-0.32 

KCC78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KCC79 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KCC79 

A 

1 

40 

80 

1.13 

0.19 

0.94 

0.36 

KCC79 

B 

0 

2 

4 

-0.06 

0.40 

0.57 

-0.17 

KCC79 

C 

0 

8 

16 

0.11 

0.23 

0.75 

-0.30 

KCC79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KGll 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KGll 

A 

1 

45 

90 

1.04 

0.17 

1.06 

0.33 

KGll 

B 

0 

2 

4 

-0.47 

0.00 

0.38 

-0.25 

KGll 

C 

0 

3 

6 

-0.04 

0.33 

0.65 

-0.21 

KGll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG12 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG12 

A 

1 

39 

80 

1.84 

0.23 

0.82 

0.46 

KG12 

B 

0 

5 

10 

0.44 

0.38 

0.79 

-0.24 

KG12 

C 

0 

5 

10 

-0.18 

0.46 

0.46 

-0.38 

KG12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG13 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG13 

A 

1 

30 

63 

1.17 

0.14 

1.05 

0.32 

KG13 

B 

0 

6 

13 

0.43 

0.18 

0.68 

-0.27 

KG13 

C 

0 

12 

25 

0.78 

0.22 

1.16 

-0.15 

KG13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG14 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG14 

A 

1 

37 

77 

1.16 

0.16 

1.19 

0.23 

KG14 

B 

0 

5 

10 

1.10 

0.29 

1.51 

0.02 

KG14 

C 

0 

6 

13 

0.28 

0.14 

0.60 

-0.31 

KG14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG21 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG21 

A 

1 

41 

85 

1.26 

0.18 

1.06 

0.25 

KG21 

B 

0 

4 

8 

0.32 

0.40 

0.81 

-0.22 

KG21 

C 

0 

3 

6 

0.65 

0.46 

1.06 

-0.11 

KG21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG22 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG22 

A 

1 

46 

90 

1.66 

0.16 

1.06 

0.26 

KG22 

B 

0 

3 

6 

0.39 

0.35 

0.52 

-0.28 

KG22 

C 

0 

2 

4 

1.25 

0.97 

1.66 

-0.06 

KG22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG23 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG23 

A 

1 

46 

90 

1.42 

0.16 

0.89 

0.39 

KG23 

B 

0 

2 

4 

-0.60 

0.68 

0.30 

-0.33 

KG23 

C 

0 

3 

6 

0.27 

0.75 

0.94 

-0.22 

KG23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG24 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

KG24 

A 

1 

42 

86 

1.91 

0.16 

0.81 

0.50 

KG24 

B 

0 

1 

2 

1.29 

0.00 

1.08 

-0.04 

KG24 

C 

0 

6 

12 

-0.05 

0.56 

0.48 

-0.52 

KG24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG31 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG31 

A 

1 

40 

77 

2.06 

0.18 

1.02 

0.36 

KG31 

B 

0 

8 

15 

1.03 

0.38 

1.05 

-0.29 

KG31 

C 

0 

4 

8 

1.14 

0.24 

0.75 

-0.17 

KG31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG310 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG310 

A 

1 

41 

84 

1.35 

0.17 

0.92 

0.40 

KG310 

B 

0 

4 

8 

0.10 

0.24 

0.56 

-0.28 

KG310 

C 

0 

4 

8 

0.17 

0.67 

1.19 

-0.26 

KG310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG311 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KG311 

A 

1 

42 

89 

1.56 

0.18 

0.98 

0.29 

KG311 

B 

0 

1 

2 

-0.15 

0.00 

0.32 

-0.20 

KG311 

C 

0 

4 

9 

0.61 

0.50 

1.06 

-0.22 

KG311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG312 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KG312 

A 

1 

38 

73 

1.71 

0.14 

0.84 

0.55 

KG312 

B 

0 

6 

12 

0.63 

0.20 

0.62 

-0.30 

KG312 

C 

0 

8 

15 

0.53 

0.20 

0.56 

-0.41 

KG312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG313 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KG313 

A 

1 

18 

38 

1.45 

0.32 

2.43 

-0.02 

KG313 

B 

0 

13 

27 

1.60 

0.39 

1.99 

0.06 

KG313 

C 

0 

17 

35 

1.41 

0.29 

1.51 

-0.04 

KG313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG314 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KG314 

A 

1 

15 

30 

2.51 

0.40 

1.00 

0.52 

KG314 

B 

0 

3 

6 

0.38 

0.53 

0.37 

-0.25 

KG314 

C 

0 

32 

64 

1.22 

0.12 

0.82 

-0.38 

KG314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG315 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG315 

A 

1 

44 

88 

1.05 

0.18 

0.97 

0.31 

KG315 

B 

0 

3 

6 

-0.30 

0.25 

0.46 

-0.27 

KG315 

C 

0 

3 

6 

0.19 

0.09 

0.71 

-0.16 

KG315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG316 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG316 

A 

1 

35 

70 

1.10 

0.17 

1.05 

0.24 

KG316 

B 

0 

10 

20 

0.42 

0.52 

4.12 

-0.22 

KG316 

C 

0 

5 

10 

0.63 

0.33 

1.14 

-0.08 

KG316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG317 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG317 

A 

1 

29 

59 

2.00 

0.30 

1.16 

0.41 

KG317 

B 

0 

13 

27 

0.73 

0.27 

0.93 

-0.31 

KG317 

C 

0 

7 

14 

0.78 

0.33 

0.87 

-0.20 

KG317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG318 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG318 

A 

1 

28 

58 

1.22 

0.15 

1.02 

0.38 

KG318 

B 

0 

9 

19 

0.77 

0.15 

0.93 

-0.13 

KG318 

C 

0 

11 

23 

0.51 

0.20 

0.82 

-0.33 

KG318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG319 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG319 

A 

1 

33 

69 

1.31 

0.16 

0.98 

0.43 

KG319 

B 

0 

10 

21 

0.45 

0.30 

0.96 

-0.32 

KG319 

C 

0 

5 

10 

0.44 

0.20 

0.69 

-0.22 

KG319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG32 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG32 

A 

1 

33 

69 

1.47 

0.21 

1.03 

0.42 

KG32 

B 

0 

12 

25 

0.55 

0.19 

0.82 

-0.30 

KG32 

C 

0 

3 

6 

-0.01 

0.32 

0.44 

-0.26 

KG32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG320 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG320 

A 

1 

25 

49 

2.05 

0.19 

0.90 

0.44 

KG320 

B 

0 

7 

14 

0.56 

0.35 

0.49 

-0.38 

KG320 

C 

0 

19 

37 

1.32 

0.22 

1.20 

-0.19 

KG320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG321 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG321 

A 

1 

34 

67 

1.62 

0.18 

0.94 

0.42 

KG321 

B 

0 

4 

8 

1.31 

0.63 

2.09 

0.01 

KG321 

C 

0 

13 

25 

0.36 

0.26 

0.66 

-0.46 

KG321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG322 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.04 

KG322 

A 

1 

44 

90 

1.86 

0.16 

0.81 

0.49 

KG322 

B 

0 

4 

8 

-0.29 

0.79 

0.47 

-0.47 

KG322 

C 

0 

1 

2 

0.50 

0.00 

0.53 

-0.14 

KG322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG323 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG323 

A 

1 

46 

88 

2.02 

0.16 

0.87 

0.44 

KG323 

B 

0 

3 

6 

-0.06 

0.38 

0.27 

-0.40 

KG323 

C 

0 

3 

6 

0.89 

0.34 

0.67 

-0.20 

KG323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG324 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG324 

A 

1 

36 

73 

1.51 

0.17 

0.83 

0.54 

KG324 

B 

0 

4 

8 

-0.56 

0.21 

0.26 

-0.45 

KG324 

C 

0 

9 

18 

0.46 

0.22 

0.84 

-0.29 

KG324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG325 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KG325 

A 

1 

42 

89 

1.62 

0.17 

0.87 

0.43 

KG325 

B 

0 

2 

4 

-0.48 

0.33 

0.24 

-0.34 

KG325 

C 

0 

3 

6 

0.27 

0.05 

0.49 

-0.26 

KG325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG326 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KG326 

A 

1 

45 

87 

1.53 

0.13 

0.93 

0.35 

KG326 

B 

0 

5 

10 

0.67 

0.36 

0.79 

-0.26 

KG326 

C 

0 

2 

4 

0.34 

0.24 

0.47 

-0.23 

KG326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG327 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KG327 

A 

1 

43 

90 

1.67 

0.18 

0.88 

0.45 

KG327 

B 

0 

1 

2 

-0.44 

0.00 

0.26 

-0.22 

KG327 

C 

0 

4 

8 

-0.14 

0.35 

0.41 

-0.38 

KG327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG328 

* 

-1 

1217 

92 

1.38 

0.04 

0.00 

-0.01 

KG328 

A 

1 

93 

91 

1.55 

0.11 

0.94 

0.37 

KG328 

B 

0 

6 

6 

0.01 

0.31 

0.47 

-0.32 

KG328 

C 

0 

3 

3 

0.28 

0.69 

0.71 

-0.18 

KG328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG329 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KG329 

A 

1 

44 

88 

1.69 

0.18 

0.97 

0.30 

KG329 

B 

0 

5 

10 

0.48 

0.40 

0.73 

-0.30 

KG329 

C 

0 

1 

2 

1.16 

0.00 

1.04 

-0.05 

KG329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG33 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG33 

A 

1 

38 

76 

1.16 

0.19 

0.90 

0.37 

KG33 

B 

0 

3 

6 

-0.25 

0.28 

0.45 

-0.25 

KG33 

C 

0 

9 

18 

0.28 

0.27 

0.95 

-0.26 

KG33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG330 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG330 

A 

1 

31 

62 

1.26 

0.21 

1.04 

0.38 

KG330 

B 

0 

7 

14 

0.14 

0.21 

0.60 

-0.28 

KG330 

C 

0 

12 

24 

0.49 

0.31 

1.06 

-0.21 

KG330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG331 

* 

-1 

1222 

93 

1.39 

0.04 

0.00 

0.03 

KG331 

A 

1 

57 

59 

1.74 

0.16 

0.85 

0.49 

KG331 

B 

0 

31 

32 

0.54 

0.13 

0.76 

-0.39 

KG331 

C 

0 

9 

9 

0.47 

0.30 

0.79 

-0.20 

KG331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG332 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG332 

A 

1 

25 

51 

2.12 

0.33 

1.15 

0.43 

KG332 

B 

0 

18 

37 

0.82 

0.21 

0.95 

-0.34 

KG332 

C 

0 

6 

12 

0.91 

0.53 

1.03 

-0.15 

KG332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG333 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG333 

A 

1 

23 

48 

1.38 

0.16 

0.86 

0.50 

KG333 

B 

0 

16 

33 

0.52 

0.17 

0.76 

-0.42 

KG333 

C 

0 

9 

19 

0.77 

0.15 

0.88 

-0.13 

KG333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG334 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG334 

A 

1 

25 

52 

1.36 

0.14 

0.90 

0.36 

KG334 

B 

0 

20 

42 

0.58 

0.23 

1.41 

-0.42 

KG334 

C 

0 

3 

6 

1.45 

0.54 

1.93 

0.11 

KG334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG335 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG335 

A 

1 

19 

40 

1.62 

0.31 

1.25 

0.34 

KG335 

B 

0 

11 

23 

1.06 

0.27 

1.29 

-0.04 

KG335 

C 

0 

18 

38 

0.70 

0.20 

0.91 

-0.31 

KG335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG336 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG336 

A 

1 

24 

47 

1.98 

0.20 

1.09 

0.36 

KG336 

B 

0 

2 

4 

0.41 

1.34 

0.62 

-0.22 

KG336 

C 

0 

25 

49 

1.28 

0.20 

1.27 

-0.27 

KG336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG337 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG337 

A 

1 

19 

37 

2.16 

0.24 

0.76 

0.59 

KG337 

B 

0 

20 

39 

0.85 

0.22 

0.87 

-0.29 

KG337 

C 

0 

12 

24 

0.56 

0.21 

0.53 

-0.34 

KG337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG338 

* 

-1 

1223 

93 

1.39 

0.04 

0.00 

0.02 

KG338 

A 

1 

52 

54 

1.77 

0.16 

0.97 

0.45 

KG338 

B 

0 

23 

24 

0.78 

0.17 

0.89 

-0.25 

KG338 

C 

0 

21 

22 

0.67 

0.22 

1.07 

-0.29 

KG338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG339 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KG339 

A 

1 

25 

52 

2.15 

0.22 

0.99 

0.40 

KG339 

B 

0 

12 

25 

1.05 

0.23 

0.69 

-0.37 

KG339 

C 

0 

11 

23 

1.56 

0.30 

1.29 

-0.09 

KG339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG34 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG34 

A 

1 

48 

92 

1.94 

0.16 

0.92 

0.32 

KG34 

B 

0 

2 

4 

0.88 

0.65 

0.77 

-0.16 

KG34 

C 

0 

2 

4 

0.16 

0.96 

0.46 

-0.29 

KG34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG340 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG340 

A 

1 

19 

39 

1.70 

0.26 

1.08 

0.39 

KG340 

B 

0 

12 

24 

1.14 

0.34 

1.73 

-0.01 

KG340 

C 

0 

18 

37 

0.58 

0.20 

0.75 

-0.38 

KG340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG341 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KG341 

A 

1 

30 

64 

1.86 

0.21 

0.90 

0.47 

KG341 

B 

0 

6 

13 

0.67 

0.29 

0.73 

-0.25 

KG341 

C 

0 

11 

23 

0.74 

0.28 

0.91 

-0.33 

KG341 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG342 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KG342 

A 

1 

28 

54 

1.25 

0.17 

1.53 

-0.18 

KG342 

B 

0 

16 

31 

1.51 

0.24 

1.91 

0.08 

KG342 

C 

0 

8 

15 

1.73 

0.36 

2.43 

0.15 

KG342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG35 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KG35 

A 

1 

43 

90 

1.67 

0.18 

0.88 

0.45 

KG35 

B 

0 

2 

4 

-0.76 

0.32 

0.20 

-0.37 

KG35 

C 

0 

3 

6 

0.17 

0.24 

0.50 

-0.27 

KG35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG36 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KG36 

A 

1 

43 

86 

1.72 

0.18 

0.96 

0.33 

KG36 

B 

0 

3 

6 

0.10 

0.36 

0.40 

-0.30 

KG36 

C 

0 

4 

8 

0.91 

0.34 

0.92 

-0.16 

KG36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG37 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG37 

A 

1 

20 

40 

1.36 

0.34 

1.23 

0.31 

KG37 

B 

0 

15 

30 

0.72 

0.21 

1.19 

-0.11 

KG37 

C 

0 

15 

30 

0.53 

0.20 

0.92 

-0.22 

KG37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG38 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG38 

A 

1 

35 

70 

1.19 

0.19 

1.16 

0.36 

KG38 

B 

0 

10 

20 

0.43 

0.31 

1.20 

-0.21 

KG38 

C 

0 

5 

10 

-0.03 

0.35 

0.60 

-0.28 

KG38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG39 

* 

-1 

1221 

93 

1.37 

0.04 

0.00 

-0.02 

KG39 

A 

1 

71 

72 

1.83 

0.14 

0.95 

0.41 

KG39 

B 

0 

16 

16 

1.15 

0.23 

1.36 

-0.13 

KG39 

C 

0 

11 

11 

0.04 

0.19 

0.38 

-0.42 

KG39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG41 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG41 

A 

1 

46 

94 

1.58 

0.21 

0.89 

0.23 

KG41 

B 

0 

3 

6 

0.17 

1.23 

2.06 

-0.23 

KG41 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG42 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG42 

A 

1 

44 

92 

1.05 

0.12 

0.99 

0.30 

KG42 

B 

0 

3 

6 

0.25 

0.21 

0.63 

-0.25 

KG42 

C 

0 

1 

2 

0.13 

0.00 

0.54 

-0.16 

KG42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG43 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG43 

A 

1 

37 

77 

1.07 

0.16 

1.19 

0.06 

KG43 

B 

0 

8 

17 

0.73 

0.34 

1.25 

-0.15 

KG43 

C 

0 

3 

6 

1.52 

0.49 

2.56 

0.13 

KG43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG44 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG44 

A 

1 

40 

83 

1.17 

0.19 

1.20 

0.06 

KG44 

B 

0 

6 

13 

0.98 

0.36 

1.57 

-0.05 

KG44 

C 

0 

2 

4 

1.08 

0.00 

1.33 

-0.01 

KG44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG51 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG51 

A 

1 

36 

71 

1.80 

0.17 

1.04 

0.32 

KG51 

B 

0 

8 

16 

0.73 

0.29 

0.68 

-0.34 

KG51 

C 

0 

7 

14 

1.39 

0.45 

1.51 

-0.07 

KG51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG510 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG510 

A 

1 

42 

82 

1.58 

0.15 

0.77 

0.58 

KG510 

B 

0 

7 

14 

-0.37 

0.27 

0.34 

-0.57 

KG510 

C 

0 

2 

4 

0.57 

0.17 

0.72 

-0.12 

KG510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG511 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KG511 

A 

1 

45 

94 

1.83 

0.16 

1.00 

0.31 

KG511 

B 

0 

2 

4 

0.50 

0.00 

0.46 

-0.24 

KG511 

C 

0 

1 

2 

0.32 

0.00 

0.39 

-0.19 

KG511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG512 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG512 

A 

1 

36 

69 

2.12 

0.20 

1.04 

0.38 

KG512 

B 

0 

6 

12 

0.90 

0.42 

0.71 

-0.29 

KG512 

C 

0 

10 

19 

1.33 

0.24 

1.00 

-0.21 

KG512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG513 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG513 

A 

1 

33 

67 

1.56 

0.19 

0.95 

0.53 

KG513 

B 

0 

9 

18 

0.32 

0.25 

0.74 

-0.35 

KG513 

C 

0 

7 

14 

0.27 

0.25 

0.63 

-0.32 

KG513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG514 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KG514 

A 

1 

34 

72 

1.73 

0.21 

1.05 

0.40 

KG514 

B 

0 

5 

11 

0.40 

0.22 

0.53 

-0.30 

KG514 

C 

0 

8 

17 

0.86 

0.27 

0.96 

-0.23 

KG514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG515 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KG515 

A 

1 

26 

50 

1.62 

0.20 

1.19 

0.23 

KG515 

B 

0 

10 

19 

0.66 

0.18 

0.55 

-0.40 

KG515 

C 

0 

16 

31 

1.52 

0.17 

1.42 

0.09 

KG515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG516 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KG516 

A 

1 

37 

77 

1.81 

0.19 

0.96 

0.48 

KG516 

B 

0 

8 

17 

0.57 

0.39 

1.24 

-0.32 

KG516 

C 

0 

3 

6 

-0.19 

0.22 

0.29 

-0.34 

KG516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG517 

* 

-1 

1219 

92 

1.42 

0.04 

0.00 

0.09 

KG517 

A 

1 

83 

83 

1.14 

0.12 

0.86 

0.42 

KG517 

B 

0 

9 

9 

0.15 

0.26 

0.85 

-0.21 

KG517 

C 

0 

8 

8 

-0.50 

0.28 

0.43 

-0.36 

KG517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG518 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KG518 

A 

1 

30 

60 

1.93 

0.24 

1.00 

0.39 

KG518 

B 

0 

10 

20 

0.91 

0.27 

0.85 

-0.27 

KG518 

C 

0 

10 

20 

1.06 

0.25 

1.00 

-0.20 

KG518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG519 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG519 

A 

1 

42 

84 

1.08 

0.18 

0.93 

0.32 

KG519 

B 

0 

6 

12 

0.29 

0.33 

1.02 

-0.20 

KG519 

C 

0 

2 

4 

-0.60 

0.30 

0.33 

-0.27 

KG519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG52 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG52 

A 

1 

36 

72 

1.21 

0.18 

0.89 

0.42 

KG52 

B 

0 

9 

18 

0.33 

0.32 

1.07 

-0.24 

KG52 

C 

0 

5 

10 

-0.17 

0.59 

0.87 

-0.32 

KG52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG520 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG520 

A 

1 

38 

78 

1.64 

0.26 

1.38 

0.18 

KG520 

B 

0 

5 

10 

0.75 

0.38 

1.00 

-0.17 

KG520 

C 

0 

6 

12 

1.20 

0.46 

1.94 

-0.07 

KG520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG521 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG521 

A 

1 

38 

79 

1.14 

0.12 

0.94 

0.43 

KG521 

B 

0 

7 

15 

0.31 

0.23 

0.68 

-0.36 

KG521 

C 

0 

3 

6 

0.42 

0.25 

0.71 

-0.19 

KG521 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG522 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG522 

A 

1 

33 

69 

1.30 

0.15 

0.89 

0.41 

KG522 

B 

0 

5 

10 

0.42 

0.33 

0.76 

-0.22 

KG522 

C 

0 

10 

21 

0.50 

0.34 

1.09 

-0.29 

KG522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG523 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG523 

A 

1 

38 

79 

1.29 

0.19 

1.05 

0.25 

KG523 

B 

0 

4 

8 

1.21 

0.07 

1.46 

0.02 

KG523 

C 

0 

6 

13 

0.19 

0.39 

0.74 

-0.32 

KG523 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG524 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG524 

A 

1 

40 

78 

1.86 

0.15 

0.88 

0.51 

KG524 

B 

0 

6 

12 

0.49 

0.37 

0.59 

-0.37 

KG524 

C 

0 

5 

10 

0.58 

0.35 

0.63 

-0.31 

KG524 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG525 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG525 

A 

1 

37 

73 

1.60 

0.18 

0.99 

0.46 

KG525 

B 

0 

8 

16 

0.37 

0.31 

0.70 

-0.34 

KG525 

C 

0 

6 

12 

0.47 

0.39 

0.82 

-0.25 

KG525 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG526 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KG526 

A 

1 

29 

60 

2.12 

0.20 

1.10 

0.43 

KG526 

B 

0 

8 

17 

1.25 

0.35 

1.07 

-0.20 

KG526 

C 

0 

11 

23 

1.10 

0.24 

0.85 

-0.32 

KG526 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG527 

* 

-1 

1217 

92 

1.35 

0.04 

0.00 

-0.07 

KG527 

A 

1 

71 

70 

1.97 

0.15 

1.71 

0.29 

KG527 

B 

0 

17 

17 

1.41 

0.19 

1.20 

-0.12 

KG527 

C 

0 

14 

14 

0.97 

0.29 

0.97 

-0.26 

KG527 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG528 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG528 

A 

1 

38 

73 

2.10 

0.19 

1.11 

0.37 

KG528 

B 

0 

9 

17 

0.86 

0.26 

0.66 

-0.38 

KG528 

C 

0 

5 

10 

1.56 

0.33 

1.24 

-0.08 

KG528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG529 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG529 

A 

1 

37 

76 

1.50 

0.17 

0.84 

0.55 

KG529 

B 

0 

6 

12 

-0.05 

0.22 

0.45 

-0.40 

KG529 

C 

0 

6 

12 

0.19 

0.32 

0.70 

-0.32 

KG529 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG53 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KG53 

A 

1 

38 

81 

1.61 

0.20 

1.07 

0.29 

KG53 

B 

0 

5 

11 

0.82 

0.37 

1.05 

-0.18 

KG53 

C 

0 

4 

9 

0.65 

0.39 

0.83 

-0.20 

KG53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG530 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KG530 

A 

1 

35 

67 

1.71 

0.15 

0.88 

0.48 

KG530 

B 

0 

11 

21 

0.83 

0.21 

0.84 

-0.32 

KG530 

C 

0 

6 

12 

0.65 

0.27 

0.63 

-0.30 

KG530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG531 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KG531 

A 

1 

30 

63 

1.74 

0.25 

1.38 

0.26 

KG531 

B 

0 

16 

33 

1.03 

0.28 

1.33 

-0.24 

KG531 

C 

0 

2 

4 

1.11 

0.48 

0.93 

-0.06 

KG531 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG532 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.02 

KG532 

A 

1 

35 

70 

1.72 

0.22 

1.23 

0.21 

KG532 

B 

0 

9 

18 

1.06 

0.37 

1.92 

-0.19 

KG532 

C 

0 

6 

12 

1.33 

0.23 

1.21 

-0.07 

KG532 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG533 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG533 

A 

1 

36 

72 

1.11 

0.21 

1.06 

0.27 

KG533 

B 

0 

6 

12 

0.27 

0.23 

0.78 

-0.20 

KG533 

C 

0 

8 

16 

0.52 

0.28 

1.12 

-0.15 

KG533 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG534 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG534 

A 

1 

35 

70 

1.22 

0.15 

0.82 

0.41 

KG534 

B 

0 

8 

16 

0.50 

0.61 

4.94 

-0.16 

KG534 

C 

0 

7 

14 

-0.14 

0.34 

0.56 

-0.37 

KG534 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG535 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG535 

A 

1 

47 

96 

1.61 

0.21 

0.81 

0.37 

KG535 

B 

0 

1 

2 

-1.67 

0.00 

0.09 

-0.31 

KG535 

C 

0 

1 

2 

-0.68 

0.00 

0.25 

-0.21 

KG535 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG536 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KG536 

A 

1 

46 

96 

0.98 

0.12 

1.04 

0.01 

KG536 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG536 

C 

0 

2 

4 

0.96 

0.48 

1.41 

-0.01 

KG536 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG537 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KG537 

A 

1 

40 

83 

1.16 

0.15 

1.03 

0.27 

KG537 

B 

0 

1 

2 

0.74 

0.00 

0.96 

-0.05 

KG537 

C 

0 

7 

15 

0.43 

0.33 

0.95 

-0.27 

KG537 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG538 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KG538 

A 

-1 

48 

100 

1.15 

0.17 

0.00 

0.00 

KG538 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG538 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG538 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG539 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KG539 

A 

1 

36 

71 

1.91 

0.17 

1.02 

0.49 

KG539 

B 

0 

8 

16 

1.10 

0.28 

0.94 

-0.19 

KG539 

C 

0 

7 

14 

0.38 

0.20 

0.41 

-0.45 

KG539 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG54 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KG54 

A 

1 

16 

31 

1.94 

0.29 

1.06 

0.39 

KG54 

B 

0 

30 

59 

1.07 

0.18 

1.08 

-0.21 

KG54 

C 

0 

5 

10 

0.37 

0.58 

0.65 

-0.26 

KG54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG540 

* 

-1 

1221 

93 

1.40 

0.04 

0.00 

0.04 

KG540 

A 

1 

97 

99 

1.16 

0.11 

0.99 

0.15 

KG540 

B 

0 

1 

1 

-0.43 

0.00 

0.34 

-0.15 

KG540 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG540 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG541 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KG541 

A 

1 

47 

98 

1.79 

0.15 

0.90 

0.33 

KG541 

B 

0 

1 

2 

-0.71 

0.00 

0.15 

-0.33 

KG541 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG541 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG542 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KG542 

A 

1 

50 

96 

1.82 

0.17 

1.08 

-0.03 

KG542 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG542 

C 

0 

2 

4 

2.02 

0.26 

2.15 

0.03 

KG542 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG55 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KG55 

A 

1 

34 

69 

l.SS 

O.IS 

0.S4 

0.S7 

KGS 5 

B 

0 

10 

20 

0.12 

0.23 

0.S9 

-0.46 

KGS 5 

C 

0 

S 

10 

0.32 

0.26 

0.6S 

-0.2S 

KGSS 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KGS 6 

* 

-1 

1272 

96 

1.3S 

0.04 

0.00 

-0.01 

KGS 6 

A 

1 

3S 

74 

l.SO 

0.19 

0.S4 

O.Sl 

KGS 6 

B 

0 

S 

17 

0.24 

0.23 

0.49 

-0.46 

KGS 6 

C 

0 

4 

9 

0.77 

0.33 

0.S2 

-0.17 

KGS 6 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KGS 7 

* 

-1 

1267 

96 

1.3S 

0.04 

0.00 

0.00 

KGS 7 

A 

1 

26 

SO 

1.S4 

O.IS 

1.19 

0.14 

KGS 7 

B 

0 

21 

40 

1.43 

0.21 

1.69 

0.03 

KGS 7 

C 

0 

S 

10 

0.60 

0.26 

0.S3 

-0.29 

KGS 7 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KGSS 

* 

-1 

1219 

92 

1.3S 

0.04 

0.00 

-0.01 

KGSS 

A 

1 

77 

77 

1.71 

0.12 

0.93 

0.4S 

KGSS 

B 

0 

11 

11 

0.94 

0.23 

LOS 

-0.16 

KGSS 

C 

0 

12 

12 

O.IS 

0.19 

0.4S 

-0.43 

KGSS 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KGS 9 

* 

-1 

1271 

96 

1.3S 

0.04 

0.00 

-0.01 

KGS 9 

A 

1 

44 

92 

1.60 

O.IS 

O.SS 

0.33 

KGS 9 

B 

0 

2 

4 

0.70 

1.7S 

2.S4 

-0.13 

KGS 9 

C 

0 

2 

4 

-O.Sl 

o.os 

0.2S 

-0.33 

KGS 9 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KG61 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KG61 

A 

1 

33 

67 

1.86 

0.21 

0.97 

0.32 

KG61 

B 

0 

11 

22 

1.28 

0.31 

1.84 

-0.15 

KG61 

C 

0 

5 

10 

0.57 

0.35 

0.57 

-0.30 

KG61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG62 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG62 

A 

1 

16 

32 

1.65 

0.39 

1.08 

0.43 

KG62 

B 

0 

26 

52 

0.59 

0.15 

0.94 

-0.30 

KG62 

C 

0 

8 

16 

0.54 

0.28 

0.85 

-0.14 

KG62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG63 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KG63 

A 

1 

39 

78 

1.14 

0.17 

0.88 

0.37 

KG63 

B 

0 

3 

6 

-0.86 

0.71 

0.38 

-0.39 

KG63 

C 

0 

8 

16 

0.48 

0.38 

1.47 

-0.17 

KG63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KG64 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KG64 

A 

1 

14 

29 

2.99 

0.47 

1.13 

0.64 

KG64 

B 

0 

24 

49 

0.88 

0.15 

0.61 

-0.40 

KG64 

C 

0 

11 

22 

0.92 

0.35 

0.81 

-0.21 

KG64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMDll 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KMDll 

A 

1 

38 

79 

1.11 

0.11 

0.94 

0.35 

KMDll 

B 

0 

5 

10 

0.41 

0.13 

0.68 

-0.25 

KMDll 

C 

0 

5 

10 

0.51 

0.58 

1.56 

-0.21 

KMDll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMDllO 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KMDllO 

A 

1 

41 

85 

1.23 

0.13 

0.88 

0.47 

KMDllO 

B 

0 

5 

10 

-0.28 

0.28 

0.41 

-0.48 

KMDllO 

C 

0 

2 

4 

0.59 

0.54 

0.97 

-0.10 

KMDllO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMDlll 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KMDlll 

A 

1 

41 

85 

1.28 

0.18 

0.97 

0.29 

KMDlll 

B 

0 

4 

8 

0.07 

0.51 

0.72 

-0.29 

KMDlll 

C 

0 

3 

6 

0.76 

0.61 

1.41 

-0.09 

KMDlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD112 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KMD112 

A 

1 

39 

76 

1.67 

0.17 

1.20 

0.17 

KMD112 

B 

0 

9 

18 

1.00 

0.35 

1.12 

-0.25 

KMD112 

C 

0 

3 

6 

1.99 

0.51 

2.41 

0.10 

KMD112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD113 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KMD113 

A 

1 

42 

82 

1.46 

0.18 

1.11 

0.36 

KMD113 

B 

0 

3 

6 

0.07 

0.58 

0.56 

-0.26 

KMD113 

C 

0 

6 

12 

0.53 

0.20 

0.76 

-0.23 

KMD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD114 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KMD114 

A 

1 

42 

88 

1.73 

0.17 

1.13 

-0.02 

KMD114 

B 

0 

5 

10 

2.23 

0.44 

3.48 

0.15 

KMD114 

C 

0 

1 

2 

-0.36 

0.00 

0.18 

-0.28 

KMD114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD115 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KMD115 

A 

1 

16 

31 

2.45 

0.41 

2.12 

0.36 

KMD115 

B 

0 

12 

23 

1.28 

0.24 

0.69 

-0.26 

KMD115 

C 

0 

24 

46 

1.69 

0.15 

1.05 

-0.11 

KMD115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD116 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KMD116 

A 

1 

24 

49 

1.57 

0.24 

1.08 

0.36 

KMD116 

B 

0 

15 

31 

0.86 

0.24 

1.17 

-0.17 

KMD116 

C 

0 

10 

20 

0.59 

0.33 

0.92 

-0.25 

KMD116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD12 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KMD12 

A 

1 

41 

87 

1.67 

0.17 

0.81 

0.50 

KMD12 

B 

0 

2 

4 

-0.07 

0.08 

0.34 

-0.27 

KMD12 

C 

0 

4 

9 

-0.12 

0.25 

0.35 

-0.40 

KMD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD13 

* 

-1 

1222 

93 

1.41 

0.04 

0.00 

0.06 

KMD13 

A 

1 

80 

82 

1.21 

0.10 

0.92 

0.42 

KMD13 

B 

0 

8 

8 

0.16 

0.27 

0.68 

-0.29 

KMD13 

C 

0 

9 

9 

0.27 

0.19 

0.65 

-0.27 

KMD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD14 

* 

-1 

1220 

92 

1.38 

0.04 

0.00 

-0.01 

KMD14 

A 

1 

39 

39 

1.52 

0.21 

1.75 

0.08 

KMD14 

B 

0 

11 

11 

1.11 

0.25 

0.96 

-0.11 

KMD14 

C 

0 

49 

49 

1.41 

0.13 

1.54 

-0.01 

KMD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD15 

* 

-1 

1267 

96 

1.38 

0.04 

0.00 

0.00 

KMD15 

A 

1 

46 

88 

1.46 

0.14 

1.03 

0.16 

KMD15 

B 

0 

2 

4 

1.48 

0.90 

2.04 

0.02 

KMD15 

C 

0 

4 

8 

0.77 

0.45 

1.01 

-0.20 

KMD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD16 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KMD16 

A 

1 

37 

77 

1.66 

0.21 

1.14 

0.27 

KMD16 

B 

0 

2 

4 

-0.83 

0.24 

0.15 

-0.38 

KMD16 

C 

0 

9 

19 

1.22 

0.29 

1.69 

-0.10 

KMD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD17 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KMD17 

A 

1 

35 

71 

1.84 

0.22 

1.08 

0.32 

KMD17 

B 

0 

12 

24 

0.95 

0.19 

0.83 

-0.32 

KMD17 

C 

0 

2 

4 

1.36 

0.00 

1.04 

-0.04 

KMD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD18 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD18 

A 

1 

9 

18 

2.03 

0.55 

0.85 

0.45 

KMD18 

B 

0 

28 

56 

0.67 

0.16 

0.94 

-0.24 

KMD18 

C 

0 

13 

26 

0.68 

0.28 

1.48 

-0.12 

KMD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD19 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD19 

A 

1 

44 

88 

1.12 

0.16 

0.82 

0.48 

KMD19 

B 

0 

5 

10 

-0.71 

0.38 

0.38 

-0.47 

KMD19 

C 

0 

1 

2 

0.18 

0.00 

0.72 

-0.09 

KMD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD21 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KMD21 

A 

1 

44 

90 

1.65 

0.22 

0.91 

0.31 

KMD21 

B 

0 

4 

8 

0.20 

0.70 

0.95 

-0.26 

KMD21 

C 

0 

1 

2 

-0.31 

0.00 

0.32 

-0.17 

KMD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD22 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KMD22 

A 

1 

41 

85 

1.05 

0.13 

1.06 

0.23 

KMD22 

B 

0 

3 

6 

0.47 

0.00 

0.73 

-0.17 

KMD22 

C 

0 

4 

8 

0.62 

0.23 

0.92 

-0.14 

KMD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD23 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KMD23 

A 

1 

45 

94 

1.13 

0.14 

0.96 

0.36 

KMD23 

B 

0 

3 

6 

-0.27 

0.10 

0.39 

-0.36 

KMD23 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD24 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KMD24 

A 

1 

38 

79 

1.24 

0.19 

1.06 

0.17 

KMD24 

B 

0 

6 

13 

0.58 

0.46 

1.20 

-0.19 

KMD24 

C 

0 

4 

8 

1.06 

0.60 

1.95 

-0.02 

KMD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD25 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KMD25 

A 

1 

40 

78 

1.86 

0.16 

0.94 

0.52 

KMD25 

B 

0 

6 

12 

0.37 

0.28 

0.47 

-0.41 

KMD25 

C 

0 

5 

10 

0.71 

0.32 

0.66 

-0.27 

KMD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD26 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KMD26 

A 

1 

20 

39 

1.71 

0.26 

1.22 

0.30 

KMD26 

B 

0 

9 

18 

1.01 

0.28 

0.98 

-0.10 

KMD26 

C 

0 

22 

43 

0.98 

0.25 

1.26 

-0.22 

KMD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD27 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KMD27 

A 

1 

42 

88 

1.76 

0.15 

1.03 

0.04 

KMD27 

B 

0 

5 

10 

1.84 

0.84 

4.73 

0.03 

KMD27 

C 

0 

1 

2 

0.50 

0.00 

0.43 

-0.17 

KMD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD28 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KMD28 

A 

1 

47 

90 

1.99 

0.16 

0.88 

0.43 

KMD28 

B 

0 

5 

10 

0.30 

0.29 

0.39 

-0.43 

KMD28 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD31 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KMD31 

A 

1 

44 

90 

1.27 

0.17 

0.96 

0.32 

KMD31 

B 

0 

4 

8 

0.36 

0.29 

0.82 

-0.21 

KMD31 

C 

0 

1 

2 

-1.03 

0.00 

0.18 

-0.28 

KMD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD310 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KMD310 

A 

1 

36 

77 

1.65 

0.20 

1.03 

0.32 

KMD310 

B 

0 

5 

11 

0.62 

0.54 

1.33 

-0.24 

KMD310 

C 

0 

6 

13 

0.89 

0.36 

1.09 

-0.18 

KMD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD311 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KMD311 

A 

1 

41 

80 

1.62 

0.14 

0.96 

0.43 

KMD311 

B 

0 

6 

12 

0.75 

0.14 

0.67 

-0.27 

KMD311 

C 

0 

4 

8 

0.44 

0.19 

0.50 

-0.31 

KMD311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD312 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KMD312 

A 

1 

40 

83 

1.71 

0.19 

0.94 

0.41 

KMD312 

B 

0 

2 

4 

-0.22 

0.85 

0.41 

-0.28 

KMD312 

C 

0 

6 

13 

0.48 

0.37 

0.82 

-0.30 

KMD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD313 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KMD313 

A 

1 

37 

76 

1.86 

0.20 

0.97 

0.38 

KMD313 

B 

0 

3 

6 

0.81 

0.37 

0.70 

-0.17 

KMD313 

C 

0 

9 

18 

0.81 

0.23 

0.78 

-0.32 

KMD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD314 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD314 

A 

1 

36 

72 

1.31 

0.19 

0.78 

0.53 

KMD314 

B 

0 

11 

22 

0.07 

0.13 

0.60 

-0.39 

KMD314 

C 

0 

3 

6 

-0.61 

0.17 

0.30 

-0.33 

KMD314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD315 

* 

-1 

1218 

92 

1.37 

0.04 

0.00 

-0.02 

KMD315 

A 

1 

83 

82 

1.77 

0.12 

0.84 

0.48 

KMD315 

B 

0 

6 

6 

0.99 

0.52 

1.42 

-0.11 

KMD315 

C 

0 

12 

12 

-0.08 

0.11 

0.33 

-0.49 

KMD315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD316 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD316 

A 

1 

42 

84 

1.08 

0.17 

0.98 

0.34 

KMD316 

B 

0 

6 

12 

0.43 

0.23 

1.02 

-0.16 

KMD316 

C 

0 

2 

4 

-1.18 

0.71 

0.22 

-0.37 

KMD316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD317 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KMD317 

A 

1 

38 

78 

1.84 

0.24 

0.84 

0.43 

KMD317 

B 

0 

6 

12 

0.74 

0.37 

1.06 

-0.19 

KMD317 

C 

0 

5 

10 

-0.25 

0.46 

0.42 

-0.39 

KMD317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD318 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KMD318 

A 

1 

23 

48 

1.13 

0.18 

1.17 

0.19 

KMD318 

B 

0 

10 

21 

0.68 

0.23 

0.91 

-0.20 

KMD318 

C 

0 

15 

31 

0.94 

0.17 

1.18 

-0.03 

KMD318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD319 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KMD319 

A 

1 

33 

69 

1.35 

0.15 

0.89 

0.48 

KMD319 

B 

0 

11 

23 

0.34 

0.27 

0.84 

-0.41 

KMD319 

C 

0 

4 

8 

0.45 

0.28 

0.72 

-0.19 

KMD319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD32 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KMD32 

A 

1 

47 

98 

1.15 

0.17 

1.03 

0.01 

KMD32 

B 

0 

1 

2 

1.08 

0.00 

1.53 

-0.01 

KMD32 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD320 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KMD320 

A 

1 

49 

96 

1.61 

0.15 

1.05 

0.16 

KMD320 

B 

0 

2 

4 

0.71 

0.26 

0.71 

-0.16 

KMD320 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD321 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KMD321 

A 

1 

46 

90 

1.45 

0.16 

0.86 

0.46 

KMD321 

B 

0 

2 

4 

0.33 

0.41 

0.67 

-0.17 

KMD321 

C 

0 

3 

6 

-0.81 

0.30 

0.22 

-0.45 

KMD321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD322 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KMD322 

A 

1 

43 

90 

1.83 

0.17 

1.10 

0.23 

KMD322 

B 

0 

1 

2 

1.29 

0.00 

0.97 

-0.06 

KMD322 

C 

0 

4 

8 

0.95 

0.23 

0.74 

-0.22 

KMD322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD323 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KMD323 

A 

1 

48 

92 

1.95 

0.16 

0.87 

0.34 

KMD323 

B 

0 

1 

2 

-0.28 

0.00 

0.20 

-0.25 

KMD323 

C 

0 

3 

6 

0.68 

0.89 

1.05 

-0.24 

KMD323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD324 

* 

-1 

1220 

92 

1.40 

0.04 

0.00 

0.03 

KMD324 

A 

1 

90 

91 

1.34 

0.14 

1.02 

0.32 

KMD324 

B 

0 

5 

5 

-0.33 

0.27 

0.44 

-0.26 

KMD324 

C 

0 

4 

4 

0.05 

0.54 

0.94 

-0.17 

KMD324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD325 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KMD325 

A 

1 

37 

76 

1.37 

0.18 

0.95 

0.34 

KMD325 

B 

0 

8 

16 

0.91 

0.38 

1.57 

-0.10 

KMD325 

C 

0 

4 

8 

-0.36 

0.23 

0.32 

-0.40 

KMD325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD326 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KMD326 

A 

-1 

47 

100 

1.44 

0.17 

0.00 

0.00 

KMD326 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD326 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD326 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD327 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KMD327 

A 

1 

45 

88 

1.53 

0.14 

0.98 

0.33 

KMD327 

B 

0 

1 

2 

0.90 

0.00 

0.79 

-0.08 

KMD327 

C 

0 

5 

10 

0.52 

0.17 

0.57 

-0.32 

KMD327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD328 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KMD328 

A 

1 

35 

73 

1.86 

0.20 

0.88 

0.49 

KMD328 

B 

0 

10 

21 

0.64 

0.32 

0.99 

-0.33 

KMD328 

C 

0 

3 

6 

-0.18 

0.61 

0.39 

-0.34 

KMD328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD329 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KMD329 

A 

1 

42 

86 

1.75 

0.18 

0.93 

0.31 

KMD329 

B 

0 

3 

6 

1.01 

0.46 

0.97 

-0.13 

KMD329 

C 

0 

4 

8 

0.47 

0.42 

0.62 

-0.29 

KMD329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD33 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD33 

A 

1 

16 

32 

1.20 

0.42 

1.77 

0.17 

KMD33 

B 

0 

14 

28 

1.19 

0.24 

2.17 

0.14 

KMD33 

C 

0 

20 

40 

0.50 

0.16 

0.86 

-0.29 

KMD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD330 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KMD330 

A 

1 

44 

88 

1.08 

0.16 

0.84 

0.39 

KMD330 

B 

0 

2 

4 

-0.92 

0.28 

0.25 

-0.33 

KMD330 

C 

0 

4 

8 

0.03 

0.77 

1.29 

-0.23 

KMD330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD331 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KMD331 

A 

1 

42 

86 

1.74 

0.22 

0.88 

0.41 

KMD331 

B 

0 

3 

6 

-0.02 

0.86 

0.69 

-0.26 

KMD331 

C 

0 

4 

8 

0.00 

0.19 

0.44 

-0.30 

KMD331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD332 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KMD332 

A 

1 

15 

31 

1.06 

0.20 

1.26 

0.07 

KMD332 

B 

0 

24 

50 

0.94 

0.16 

1.17 

-0.04 

KMD332 

C 

0 

9 

19 

0.93 

0.29 

1.12 

-0.03 

KMD332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD333 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

0.00 

KMD333 

A 

1 

51 

51 

1.84 

0.16 

1.02 

0.41 

KMD333 

B 

0 

31 

31 

1.05 

0.14 

0.99 

-0.20 

KMD333 

C 

0 

18 

18 

0.70 

0.26 

0.86 

-0.29 

KMD333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD334 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KMD334 

A 

1 

30 

63 

1.41 

0.16 

0.90 

0.51 

KMD334 

B 

0 

5 

10 

0.16 

0.23 

0.50 

-0.32 

KMD334 

C 

0 

13 

27 

0.53 

0.21 

0.84 

-0.33 

KMD334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD335 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KMD335 

A 

1 

41 

85 

1.25 

0.18 

1.02 

0.22 

KMD335 

B 

0 

4 

8 

1.16 

0.26 

1.64 

0.00 

KMD335 

C 

0 

3 

6 

-0.28 

0.48 

0.44 

-0.32 

KMD335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD336 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KMD336 

A 

1 

42 

82 

1.85 

0.14 

0.82 

0.55 

KMD336 

B 

0 

5 

10 

0.14 

0.33 

0.40 

-0.44 

KMD336 

C 

0 

4 

8 

0.50 

0.38 

0.56 

-0.29 

KMD336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD337 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KMD337 

A 

1 

43 

84 

1.41 

0.15 

0.88 

0.28 

KMD337 

B 

0 

7 

14 

0.79 

0.62 

2.74 

-0.17 

KMD337 

C 

0 

1 

2 

-1.28 

0.00 

0.11 

-0.31 

KMD337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD338 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KMD338 

A 

1 

42 

88 

1.89 

0.16 

0.95 

0.36 

KMD338 

B 

0 

3 

6 

1.03 

0.26 

0.77 

-0.17 

KMD338 

C 

0 

3 

6 

0.38 

0.64 

0.56 

-0.32 

KMD338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD339 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KMD339 

A 

1 

50 

96 

1.90 

0.16 

0.95 

0.32 

KMD339 

B 

0 

1 

2 

-0.28 

0.00 

0.21 

-0.25 

KMD339 

C 

0 

1 

2 

0.23 

0.00 

0.35 

-0.19 

KMD339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD34 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KMD34 

A 

1 

45 

92 

1.25 

0.16 

0.94 

0.29 

KMD34 

B 

0 

3 

6 

0.24 

0.76 

1.09 

-0.21 

KMD34 

C 

0 

1 

2 

-0.51 

0.00 

0.30 

-0.21 

KMD34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD340 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KMD340 

A 

1 

40 

85 

1.63 

0.18 

0.92 

0.38 

KMD340 

B 

0 

4 

9 

0.58 

0.22 

0.69 

-0.22 

KMD340 

C 

0 

3 

6 

0.08 

0.59 

0.54 

-0.30 

KMD340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD341 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KMD341 

A 

1 

35 

69 

1.69 

0.16 

1.01 

0.43 

KMD341 

B 

0 

3 

6 

1.48 

0.35 

1.39 

0.02 

KMD341 

C 

0 

13 

25 

0.69 

0.11 

0.60 

-0.46 

KMD341 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD342 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KMD342 

A 

1 

38 

79 

1.76 

0.19 

0.89 

0.44 

KMD342 

B 

0 

5 

10 

0.06 

0.41 

0.50 

-0.38 

KMD342 

C 

0 

5 

10 

0.72 

0.65 

1.77 

-0.20 

KMD342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KMD351 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

-0.01 

KMD351 

A 

1 

84 

84 

1.66 

0.12 

1.00 

0.38 

KMD351 

B 

0 

11 

11 

0.74 

0.25 

0.96 

-0.21 

KMD351 

C 

0 

5 

5 

-0.34 

0.62 

0.45 

-0.34 

KMD351 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KMD367 

* 

-1 

1171 

89 

1.39 

0.05 

0.00 

0.02 

KMD367 

A 

1 

69 

47 

2.02 

0.16 

0.98 

0.53 

KMD367 

B 

0 

34 

23 

0.91 

0.14 

0.97 

-0.18 

KMD367 

C 

0 

45 

30 

0.54 

0.10 

0.60 

-0.41 

KMD367 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBTll 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KNBTll 

A 

1 

22 

45 

1.97 

0.29 

1.24 

0.29 

KNBTll 

B 

0 

2 

4 

0.54 

0.44 

0.41 

-0.19 

KNBTll 

C 

0 

25 

51 

1.36 

0.19 

1.51 

-0.21 

KNBTll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBTllO 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBTllO 

A 

1 

22 

44 

1.31 

0.32 

1.26 

0.30 

KNBTllO 

B 

0 

19 

38 

0.56 

0.20 

1.15 

-0.24 

KNBTllO 

C 

0 

9 

18 

0.71 

0.17 

0.99 

-0.08 

KNBTllO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBTllOO 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBTll 00 

A 

1 

22 

44 

1.45 

0.28 

1.47 

0.42 

KNBTllOO 

B 

0 

6 

12 

0.45 

0.43 

0.91 

-0.15 

KNBTllOO 

C 

0 

22 

44 

0.51 

0.17 

0.88 

-0.32 

KNBTllOO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBTlll 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KNBTlll 

A 

1 

17 

35 

2.44 

0.42 

1.03 

0.46 

KNBTlll 

B 

0 

9 

18 

0.11 

0.29 

0.32 

-0.44 

KNBTlll 

C 

0 

23 

47 

1.33 

0.21 

1.35 

-0.10 

KNBTlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT112 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KNBT112 

A 

1 

24 

50 

1.22 

0.15 

0.99 

0.31 

KNBT112 

B 

0 

14 

29 

0.95 

0.21 

1.31 

-0.02 

KNBT112 

C 

0 

10 

21 

0.44 

0.21 

0.70 

-0.36 

KNBT112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT113 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KNBT113 

A 

1 

21 

44 

1.40 

0.23 

1.24 

0.33 

KNBT113 

B 

0 

11 

23 

0.73 

0.18 

0.83 

-0.18 

KNBT113 

C 

0 

16 

33 

0.79 

0.22 

1.02 

-0.19 

KNBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT114 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KNBT114 

A 

1 

10 

21 

1.78 

0.53 

1.19 

0.29 

KNBT114 

B 

0 

7 

15 

1.31 

0.39 

1.48 

0.06 

KNBT114 

C 

0 

31 

65 

0.90 

0.16 

0.98 

-0.29 

KNBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT115 

* 

-1 

1220 

92 

1.40 

0.04 

0.00 

0.03 

KNBT115 

A 

1 

46 

46 

1.75 

0.23 

1.35 

0.37 

KNBT115 

B 

0 

29 

29 

0.70 

0.17 

0.99 

-0.24 

KNBT115 

C 

0 

24 

24 

0.76 

0.19 

0.99 

-0.18 

KNBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT116 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KNBT116 

A 

1 

32 

63 

1.93 

0.19 

1.12 

0.43 

KNBT116 

B 

0 

12 

24 

0.96 

0.28 

0.86 

-0.32 

KNBT116 

C 

0 

7 

14 

1.00 

0.14 

0.67 

-0.21 

KNBT116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT117 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KNBT117 

A 

1 

31 

61 

1.63 

0.20 

0.99 

0.38 

KNBT117 

B 

0 

1 

2 

1.72 

0.00 

1.79 

0.06 

KNBT117 

C 

0 

19 

37 

0.67 

0.24 

0.97 

-0.40 

KNBT117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT118 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KNBT118 

A 

1 

18 

38 

2.11 

0.34 

1.81 

0.26 

KNBT118 

B 

0 

16 

33 

1.48 

0.20 

1.05 

-0.17 

KNBT118 

C 

0 

14 

29 

1.57 

0.22 

1.01 

-0.10 

KNBT118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT119 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KNBT119 

A 

1 

29 

56 

2.27 

0.20 

0.92 

0.42 

KNBT119 

B 

0 

19 

37 

1.35 

0.26 

1.50 

-0.31 

KNBT119 

C 

0 

4 

8 

0.97 

0.34 

0.56 

-0.21 

KNBT119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT12 

* 

-1 

1270 

96 

1.39 

0.04 

0.00 

0.03 

KNBT12 

A 

1 

36 

73 

1.35 

0.20 

1.18 

0.29 

KNBT12 

B 

0 

2 

4 

1.40 

0.21 

1.74 

0.04 

KNBT12 

C 

0 

11 

22 

0.47 

0.22 

0.91 

-0.33 

KNBT12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT120 

* 

-1 

1219 

92 

1.39 

0.04 

0.00 

0.03 

KNBT120 

A 

1 

79 

79 

1.42 

0.14 

1.06 

0.29 

KNBT120 

B 

0 

15 

15 

0.71 

0.21 

1.20 

-0.18 

KNBT120 

C 

0 

6 

6 

0.18 

0.20 

0.56 

-0.22 

KNBT120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT121 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT121 

A 

1 

37 

79 

1.62 

0.20 

1.11 

0.29 

KNBT121 

B 

0 

9 

19 

0.85 

0.23 

0.98 

-0.24 

KNBT121 

C 

0 

1 

2 

0.17 

0.00 

0.40 

-0.16 

KNBT121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT122 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT122 

A 

1 

38 

75 

1.71 

0.14 

0.85 

0.53 

KNBT122 

B 

0 

8 

16 

0.60 

0.22 

0.63 

-0.38 

KNBT122 

C 

0 

5 

10 

0.56 

0.19 

0.55 

-0.31 

KNBT122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT123 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT123 

A 

1 

36 

75 

1.83 

0.20 

0.97 

0.48 

KNBT123 

B 

0 

8 

17 

0.25 

0.25 

0.55 

-0.43 

KNBT123 

C 

0 

4 

8 

0.71 

0.77 

1.83 

-0.18 

KNBT123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT124 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KNBT124 

A 

1 

14 

29 

2.20 

0.37 

1.06 

0.32 

KNBT124 

B 

0 

28 

57 

1.48 

0.20 

1.74 

-0.12 

KNBT124 

C 

0 

7 

14 

0.89 

0.33 

0.61 

-0.25 

KNBT124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT125 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT125 

A 

1 

6 

12 

1.62 

1.04 

3.15 

0.22 

KNBT125 

B 

0 

28 

56 

0.93 

0.17 

1.33 

0.01 

KNBT125 

C 

0 

16 

32 

0.64 

0.19 

0.74 

-0.17 

KNBT125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT126 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT126 

A 

1 

19 

38 

1.36 

0.32 

1.39 

0.31 

KNBT126 

B 

0 

14 

28 

0.67 

0.22 

0.93 

-0.13 

KNBT126 

C 

0 

17 

34 

0.62 

0.24 

0.98 

-0.19 

KNBT126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT127 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT127 

A 

1 

26 

53 

2.12 

0.34 

1.70 

0.45 

KNBT127 

B 

0 

12 

24 

0.63 

0.22 

0.69 

-0.33 

KNBT127 

C 

0 

11 

22 

0.95 

0.19 

0.87 

-0.20 

KNBT127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT128 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KNBT128 

A 

1 

18 

38 

1.37 

0.20 

0.99 

0.40 

KNBT128 

B 

0 

14 

29 

0.75 

0.16 

0.87 

-0.19 

KNBT128 

C 

0 

16 

33 

0.73 

0.17 

0.89 

-0.23 

KNBT128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT129 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KNBT129 

A 

1 

22 

46 

1.40 

0.16 

0.89 

0.35 

KNBT129 

B 

0 

13 

27 

0.67 

0.26 

0.98 

-0.24 

KNBT129 

C 

0 

13 

27 

0.82 

0.30 

1.33 

-0.15 

KNBT129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT13 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KNBT13 

A 

1 

8 

17 

2.54 

0.56 

0.64 

0.55 

KNBT13 

B 

0 

8 

17 

0.92 

0.19 

0.76 

-0.09 

KNBT13 

C 

0 

32 

67 

0.85 

0.15 

0.88 

-0.36 

KNBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT130 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.03 

KNBT130 

A 

1 

22 

43 

1.76 

0.27 

1.71 

0.15 

KNBT130 

B 

0 

13 

25 

1.25 

0.30 

1.03 

-0.18 

KNBT130 

C 

0 

16 

31 

1.58 

0.17 

1.18 

0.00 

KNBT130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT131 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KNBT131 

A 

1 

17 

33 

1.98 

0.28 

0.98 

0.43 

KNBT131 

B 

0 

16 

31 

0.68 

0.18 

0.57 

-0.35 

KNBT131 

C 

0 

18 

35 

1.13 

0.28 

1.32 

-0.09 

KNBT131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT132 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KNBT132 

A 

1 

27 

56 

2.06 

0.22 

1.26 

0.33 

KNBT132 

B 

0 

9 

19 

1.03 

0.36 

1.03 

-0.31 

KNBT132 

C 

0 

12 

25 

1.56 

0.20 

1.13 

-0.10 

KNBT132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT133 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KNBT133 

A 

1 

21 

40 

2.47 

0.27 

1.01 

0.45 

KNBT133 

B 

0 

13 

25 

1.62 

0.24 

1.21 

-0.11 

KNBT133 

C 

0 

18 

35 

1.24 

0.23 

0.81 

-0.37 

KNBT133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Kindergarten Math Measure Development 


373 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT134 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

KNBT134 

A 

1 

17 

35 

1.59 

0.19 

0.96 

0.37 

KNBT134 

B 

0 

8 

17 

0.88 

0.39 

1.49 

-0.09 

KNBT134 

C 

0 

23 

48 

0.77 

0.21 

1.04 

-0.29 

KNBT134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT135 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT135 

A 

1 

31 

66 

1.84 

0.21 

0.90 

0.47 

KNBT135 

B 

0 

12 

26 

0.59 

0.24 

0.75 

-0.42 

KNBT135 

C 

0 

4 

9 

0.94 

0.42 

1.02 

-0.13 

KNBT135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT136 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT136 

A 

1 

38 

75 

1.64 

0.15 

0.94 

0.40 

KNBT136 

B 

0 

3 

6 

0.21 

0.42 

0.42 

-0.33 

KNBT136 

C 

0 

10 

20 

0.96 

0.18 

0.88 

-0.25 

KNBT136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT137 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT137 

A 

1 

36 

75 

1.85 

0.20 

0.94 

0.50 

KNBT137 

B 

0 

5 

10 

0.22 

0.36 

0.53 

-0.34 

KNBT137 

C 

0 

7 

15 

0.46 

0.32 

0.67 

-0.33 

KNBT137 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT138 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KNBT138 

A 

1 

36 

73 

1.82 

0.20 

0.98 

0.32 

KNBT138 

B 

0 

5 

10 

1.47 

0.36 

1.51 

-0.04 

KNBT138 

C 

0 

8 

16 

0.68 

0.25 

0.65 

-0.34 

KNBT138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT139 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT139 

A 

1 

27 

54 

1.42 

0.25 

0.94 

0.47 

KNBT139 

B 

0 

8 

16 

0.31 

0.26 

0.85 

-0.23 

KNBT139 

C 

0 

15 

30 

0.34 

0.16 

0.76 

-0.33 

KNBT139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT14 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT14 

A 

1 

28 

56 

1.39 

0.21 

0.91 

0.47 

KNBT14 

B 

0 

13 

26 

0.42 

0.28 

0.99 

-0.26 

KNBT14 

C 

0 

9 

18 

0.15 

0.26 

0.67 

-0.32 

KNBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT140 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT140 

A 

1 

31 

63 

2.06 

0.27 

0.97 

0.50 

KNBT140 

B 

0 

9 

18 

0.60 

0.21 

0.70 

-0.28 

KNBT140 

C 

0 

9 

18 

0.42 

0.34 

0.71 

-0.34 

KNBT140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT141 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KNBT141 

A 

1 

31 

65 

1.18 

0.15 

1.03 

0.35 

KNBT141 

B 

0 

12 

25 

0.69 

0.11 

0.86 

-0.21 

KNBT141 

C 

0 

5 

10 

0.42 

0.38 

0.79 

-0.25 

KNBT141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT142 

* 

-1 

1222 

93 

1.41 

0.04 

0.00 

0.06 

KNBT142 

A 

1 

74 

76 

1.20 

0.10 

0.98 

0.33 

KNBT142 

B 

0 

17 

18 

0.65 

0.18 

1.12 

-0.20 

KNBT142 

C 

0 

6 

6 

0.07 

0.32 

0.58 

-0.28 

KNBT142 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT143 

* 

-1 

1218 

92 

1.37 

0.04 

0.00 

-0.02 

KNBT143 

A 

1 

64 

63 

1.94 

0.14 

0.95 

0.49 

KNBT143 

B 

0 

24 

24 

0.95 

0.20 

1.20 

-0.26 

KNBT143 

C 

0 

13 

13 

0.35 

0.22 

0.53 

-0.37 

KNBT143 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT144 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

0.00 

KNBT144 

A 

1 

84 

84 

1.54 

0.12 

0.98 

0.31 

KNBT144 

B 

0 

12 

12 

0.74 

0.30 

1.10 

-0.21 

KNBT144 

C 

0 

4 

4 

0.14 

0.38 

0.52 

-0.22 

KNBT144 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT145 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KNBT145 

A 

1 

37 

77 

1.15 

0.16 

1.16 

0.20 

KNBT145 

B 

0 

9 

19 

0.82 

0.28 

1.35 

-0.11 

KNBT145 

C 

0 

2 

4 

0.14 

0.25 

0.52 

-0.20 

KNBT145 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT146 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KNBT146 

A 

1 

31 

65 

1.49 

0.20 

0.92 

0.41 

KNBT146 

B 

0 

9 

19 

0.54 

0.28 

0.90 

-0.26 

KNBT146 

C 

0 

8 

17 

0.48 

0.34 

0.89 

-0.26 

KNBT146 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT147 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

KNBT147 

A 

1 

39 

78 

1.80 

0.16 

1.02 

0.33 

KNBT147 

B 

0 

5 

10 

0.75 

0.35 

0.69 

-0.27 

KNBT147 

C 

0 

6 

12 

1.12 

0.50 

1.35 

-0.17 

KNBT147 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT148 

* 

-1 

1220 

92 

1.38 

0.04 

0.00 

-0.01 

KNBT148 

A 

1 

79 

80 

1.53 

0.13 

1.14 

0.20 

KNBT148 

B 

0 

4 

4 

0.76 

0.28 

0.77 

-0.13 

KNBT148 

C 

0 

16 

16 

1.07 

0.16 

1.21 

-0.15 

KNBT148 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT149 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KNBT149 

A 

1 

40 

78 

1.38 

0.17 

1.16 

0.18 

KNBT149 

B 

0 

8 

16 

0.35 

0.32 

0.77 

-0.35 

KNBT149 

C 

0 

3 

6 

2.26 

0.97 

9.34 

0.21 

KNBT149 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT15 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KNBT15 

A 

1 

33 

69 

2.03 

0.19 

1.05 

0.40 

KNBT15 

B 

0 

10 

21 

0.95 

0.29 

0.81 

-0.37 

KNBT15 

C 

0 

5 

10 

1.40 

0.17 

0.93 

-0.11 

KNBT15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT150 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KNBT150 

A 

1 

46 

88 

1.95 

0.17 

1.08 

0.29 

KNBT150 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT150 

C 

0 

6 

12 

0.91 

0.24 

0.74 

-0.29 

KNBT150 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT151 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

KNBT151 

A 

1 

20 

42 

1.10 

0.22 

1.60 

0.02 

KNBT151 

B 

0 

17 

35 

1.16 

0.27 

1.73 

0.06 

KNBT151 

C 

0 

11 

23 

0.91 

0.31 

1.17 

-0.09 

KNBT151 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT152 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT152 

A 

1 

28 

60 

1.83 

0.23 

0.98 

0.40 

KNBT152 

B 

0 

7 

15 

0.56 

0.40 

0.79 

-0.31 

KNBT152 

C 

0 

12 

26 

1.04 

0.22 

1.06 

-0.20 

KNBT152 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT153 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT153 

A 

1 

25 

49 

1.85 

0.20 

1.02 

0.46 

KNBT153 

B 

0 

14 

27 

1.05 

0.12 

0.78 

-0.25 

KNBT153 

C 

0 

12 

24 

0.97 

0.22 

0.82 

-0.27 

KNBT153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT154 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT154 

A 

1 

31 

65 

2.00 

0.20 

0.89 

0.56 

KNBT154 

B 

0 

10 

21 

0.83 

0.35 

1.19 

-0.26 

KNBT154 

C 

0 

7 

15 

0.08 

0.24 

0.36 

-0.45 

KNBT154 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT155 

* 

-1 

1270 

96 

1.37 

0.04 

0.00 

-0.03 

KNBT155 

A 

1 

13 

27 

2.42 

0.47 

1.49 

0.42 

KNBT155 

B 

0 

23 

47 

1.32 

0.17 

1.06 

-0.22 

KNBT155 

C 

0 

13 

27 

1.27 

0.19 

0.79 

-0.17 

KNBT155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT156 

* 

-1 

1270 

96 

1.40 

0.04 

0.00 

0.06 

KNBT156 

A 

1 

29 

59 

1.17 

0.26 

1.23 

0.23 

KNBT156 

B 

0 

14 

29 

0.74 

0.14 

1.10 

-0.12 

KNBT156 

C 

0 

6 

12 

0.42 

0.32 

0.91 

-0.17 

KNBT156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT157 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT157 

A 

1 

15 

30 

1.65 

0.37 

1.25 

0.42 

KNBT157 

B 

0 

22 

44 

0.51 

0.20 

0.79 

-0.31 

KNBT157 

C 

0 

13 

26 

0.75 

0.19 

0.90 

-0.08 

KNBT157 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT158 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT158 

A 

1 

26 

53 

2.23 

0.31 

1.03 

0.53 

KNBT158 

B 

0 

11 

22 

0.65 

0.15 

0.62 

-0.30 

KNBT158 

C 

0 

12 

24 

0.66 

0.31 

0.84 

-0.32 

KNBT158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT159 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KNBT159 

A 

1 

21 

44 

1.07 

0.18 

1.23 

0.10 

KNBT159 

B 

0 

18 

38 

0.81 

0.18 

1.04 

-0.17 

KNBT159 

C 

0 

9 

19 

1.11 

0.23 

1.42 

0.08 

KNBT159 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT16 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KNBT16 

A 

1 

29 

60 

1.28 

0.16 

1.00 

0.32 

KNBT16 

B 

0 

8 

17 

0.74 

0.43 

1.45 

-0.14 

KNBT16 

C 

0 

11 

23 

0.63 

0.23 

0.92 

-0.24 

KNBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT160 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

KNBT160 

A 

1 

12 

25 

1.76 

0.44 

1.22 

0.31 

KNBT160 

B 

0 

26 

54 

1.04 

0.19 

1.29 

-0.10 

KNBT160 

C 

0 

10 

21 

0.68 

0.25 

0.75 

-0.21 

KNBT160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT161 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

KNBT161 

A 

1 

14 

28 

1.77 

0.38 

2.44 

0.09 

KNBT161 

B 

0 

18 

36 

1.46 

0.19 

0.94 

-0.11 

KNBT161 

C 

0 

18 

36 

1.64 

0.23 

1.24 

0.02 

KNBT161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT162 

* 

-1 

1268 

96 

1.39 

0.04 

0.00 

0.01 

KNBT162 

A 

1 

17 

33 

1.75 

0.37 

2.36 

0.29 

KNBT162 

B 

0 

22 

43 

1.13 

0.21 

1.17 

-0.11 

KNBT162 

C 

0 

12 

24 

0.86 

0.20 

0.69 

-0.20 

KNBT162 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT163 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KNBT163 

A 

1 

16 

33 

2.46 

0.32 

1.40 

0.47 

KNBT163 

B 

0 

16 

33 

1.35 

0.22 

0.94 

-0.25 

KNBT163 

C 

0 

16 

33 

1.41 

0.19 

0.85 

-0.21 

KNBT163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT164 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KNBT164 

A 

1 

30 

58 

2.33 

0.21 

0.91 

0.50 

KNBT164 

B 

0 

4 

8 

1.05 

0.45 

0.74 

-0.19 

KNBT164 

C 

0 

18 

35 

1.17 

0.19 

0.78 

-0.41 

KNBT164 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT165 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

KNBT165 

A 

1 

21 

44 

1.50 

0.21 

1.04 

0.37 

KNBT165 

B 

0 

15 

31 

0.46 

0.22 

0.74 

-0.41 

KNBT165 

C 

0 

12 

25 

1.09 

0.28 

1.31 

0.01 

KNBT165 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT166 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT166 

A 

1 

21 

45 

1.99 

0.28 

0.99 

0.42 

KNBT166 

B 

0 

10 

21 

0.54 

0.24 

0.54 

-0.40 

KNBT166 

C 

0 

16 

34 

1.29 

0.23 

1.28 

-0.09 

KNBT166 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT167 

* 

-1 

1268 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT167 

A 

1 

29 

57 

1.74 

0.19 

1.04 

0.40 

KNBT167 

B 

0 

6 

12 

0.71 

0.38 

0.75 

-0.28 

KNBT167 

C 

0 

16 

31 

1.11 

0.12 

0.87 

-0.23 

KNBT167 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT168 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KNBT168 

A 

1 

29 

60 

1.96 

0.22 

0.98 

0.47 

KNBT168 

B 

0 

8 

17 

0.88 

0.41 

1.22 

-0.21 

KNBT168 

C 

0 

11 

23 

0.63 

0.32 

0.80 

-0.36 

KNBT168 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT171 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

-0.01 

KNBT171 

A 

1 

44 

44 

1.75 

0.20 

1.62 

0.21 

KNBT171 

B 

0 

44 

44 

1.39 

0.13 

1.26 

-0.05 

KNBT171 

C 

0 

12 

12 

0.65 

0.47 

1.06 

-0.25 

KNBT171 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT197 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.03 

KNBT197 

A 

1 

14 

29 

2.68 

0.39 

0.74 

0.60 

KNBT197 

B 

0 

9 

19 

0.77 

0.17 

0.48 

-0.33 

KNBT197 

C 

0 

25 

52 

1.25 

0.14 

0.82 

-0.29 

KNBT197 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KNBT198 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.06 

KNBT198 

A 

1 

26 

54 

1.37 

0.26 

1.02 

0.39 

KNBT198 

B 

0 

16 

33 

0.39 

0.15 

0.82 

-0.35 

KNBT198 

C 

0 

6 

13 

0.65 

0.32 

1.07 

-0.10 

KNBT198 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KNBT199 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

KNBT199 

A 

1 

18 

36 

1.29 

0.35 

1.66 

0.24 

KNBT199 

B 

0 

10 

20 

0.78 

0.22 

0.97 

-0.06 

KNBT199 

C 

0 

22 

44 

0.67 

0.21 

1.00 

-0.19 

KNBT199 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOAll 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KOAll 

A 

1 

33 

67 

1.72 

0.28 

1.50 

0.22 

KOAll 

B 

0 

7 

14 

0.64 

0.24 

0.73 

-0.23 

KOAll 

C 

0 

9 

18 

1.31 

0.49 

3.65 

-0.06 

KOAll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOAllO 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

KOAllO 

A 

1 

33 

69 

1.19 

0.12 

0.89 

0.42 

KOAllO 

B 

0 

8 

17 

0.73 

0.30 

1.19 

-0.14 

KOAllO 

C 

0 

7 

15 

0.23 

0.21 

0.58 

-0.40 

KOAllO 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOAlll 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

KOAlll 

A 

1 

15 

31 

1.53 

0.29 

1.44 

0.35 

KOAlll 

B 

0 

8 

17 

0.78 

0.20 

0.79 

-0.12 

KOAlll 

C 

0 

25 

52 

0.84 

0.17 

0.98 

-0.23 

KOAlll 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0A112 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

K0A112 

A 

1 

10 

21 

1.93 

0.51 

1.16 

0.36 

K0A112 

B 

0 

31 

65 

1.03 

0.15 

1.14 

-0.13 

K0A112 

C 

0 

7 

15 

0.51 

0.44 

0.88 

-0.23 

K0A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A113 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

K0A113 

A 

1 

30 

60 

1.87 

0.19 

1.18 

0.30 

K0A113 

B 

0 

4 

8 

0.91 

0.44 

0.67 

-0.20 

K0A113 

C 

0 

16 

32 

1.30 

0.26 

1.43 

-0.20 

K0A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A114 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.01 

K0A114 

A 

1 

35 

70 

1.58 

0.20 

1.15 

0.38 

K0A114 

B 

0 

10 

20 

0.87 

0.25 

1.02 

-0.18 

K0A114 

C 

0 

5 

10 

0.10 

0.42 

0.55 

-0.34 

K0A114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A115 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

K0A115 

A 

1 

28 

58 

2.03 

0.21 

1.06 

0.32 

K0A115 

B 

0 

10 

21 

1.14 

0.30 

0.88 

-0.28 

K0A115 

C 

0 

10 

21 

1.53 

0.32 

1.35 

-0.10 

K0A115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A116 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

K0A116 

A 

1 

25 

48 

2.26 

0.25 

1.15 

0.36 

K0A116 

B 

0 

15 

29 

1.47 

0.28 

1.24 

-0.20 

K0A116 

C 

0 

12 

23 

1.39 

0.21 

0.85 

-0.21 

K0A116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0A117 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

K0A117 

A 

1 

32 

67 

1.38 

0.17 

0.96 

0.43 

K0A117 

B 

0 

9 

19 

0.63 

0.35 

1.14 

-0.21 

K0A117 

C 

0 

7 

15 

0.25 

0.23 

0.59 

-0.34 

K0A117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A118 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

K0A118 

A 

1 

26 

55 

1.71 

0.28 

1.47 

0.25 

K0A118 

B 

0 

6 

13 

1.01 

0.34 

0.97 

-0.14 

K0A118 

C 

0 

15 

32 

1.15 

0.18 

1.06 

-0.17 

K0A118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A119 

* 

-1 

1269 

96 

1.38 

0.04 

0.00 

-0.01 

K0A119 

A 

1 

35 

70 

1.76 

0.15 

0.86 

0.53 

K0A119 

B 

0 

4 

8 

0.48 

0.44 

0.58 

-0.31 

K0A119 

C 

0 

11 

22 

0.80 

0.12 

0.66 

-0.38 

K0A119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A12 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

-0.01 

K0A12 

A 

1 

68 

68 

1.83 

0.14 

1.02 

0.45 

K0A12 

B 

0 

13 

13 

0.57 

0.41 

0.99 

-0.29 

K0A12 

C 

0 

19 

19 

0.74 

0.13 

0.70 

-0.29 

K0A12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA120 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KOA120 

A 

1 

39 

81 

1.72 

0.20 

0.98 

0.40 

KOA120 

B 

0 

8 

17 

0.34 

0.36 

0.81 

-0.40 

KOA120 

C 

0 

1 

2 

0.97 

0.00 

0.95 

-0.06 

KOA120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0A13 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.03 

K0A13 

A 

1 

15 

31 

2.19 

0.47 

1.83 

0.35 

K0A13 

B 

0 

5 

10 

0.76 

0.35 

0.56 

-0.24 

K0A13 

C 

0 

28 

58 

1.40 

0.10 

0.92 

-0.18 

K0A13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A14 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.06 

K0A14 

A 

1 

19 

40 

1.43 

0.35 

1.18 

0.33 

K0A14 

B 

0 

18 

38 

0.76 

0.16 

1.06 

-0.13 

K0A14 

C 

0 

11 

23 

0.45 

0.23 

0.83 

-0.24 

K0A14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A15 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

K0A15 

A 

1 

10 

20 

1.55 

0.54 

1.62 

0.28 

K0A15 

B 

0 

19 

38 

0.79 

0.23 

0.98 

-0.09 

K0A15 

C 

0 

21 

42 

0.73 

0.20 

0.83 

-0.14 

K0A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A16 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

K0A16 

A 

1 

44 

90 

1.65 

0.22 

0.93 

0.31 

K0A16 

B 

0 

2 

4 

-0.24 

1.43 

0.77 

-0.24 

K0A16 

C 

0 

3 

6 

0.36 

0.27 

0.67 

-0.19 

K0A16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A17 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.05 

K0A17 

A 

1 

41 

85 

1.12 

0.11 

0.92 

0.47 

K0A17 

B 

0 

7 

15 

0.11 

0.15 

0.54 

-0.47 

K0A17 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

K0A18 

* 

-1 

1271 

96 

1.40 

0.04 

0.00 

0.04 

K0A18 

A 

1 

21 

44 

1.15 

0.26 

1.78 

0.10 

K0A18 

B 

0 

21 

44 

1.08 

0.15 

1.24 

0.04 

K0A18 

C 

0 

6 

13 

0.53 

0.24 

0.66 

-0.21 

K0A18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A19 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

K0A19 

A 

1 

35 

73 

1.48 

0.19 

0.89 

0.48 

K0A19 

B 

0 

6 

13 

0.28 

0.30 

0.67 

-0.29 

K0A19 

C 

0 

7 

15 

0.22 

0.30 

0.67 

-0.34 

K0A19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A21 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

K0A21 

A 

1 

28 

56 

2.10 

0.18 

0.85 

0.53 

K0A21 

B 

0 

7 

14 

0.94 

0.27 

0.65 

-0.26 

K0A21 

C 

0 

15 

30 

1.00 

0.24 

0.80 

-0.38 

K0A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA210 

* 

-1 

1269 

96 

1.39 

0.04 

0.00 

0.01 

KOA210 

A 

1 

40 

80 

1.63 

0.16 

0.74 

0.59 

KOA210 

B 

0 

8 

16 

-0.12 

0.33 

0.50 

-0.53 

KOA210 

C 

0 

2 

4 

0.08 

0.32 

0.44 

-0.21 

KOA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A211 

* 

-1 

1219 

92 

1.38 

0.04 

0.00 

0.00 

K0A211 

A 

1 

18 

18 

2.18 

0.40 

1.96 

0.33 

K0A211 

B 

0 

70 

70 

1.23 

0.11 

0.96 

-0.21 

K0A211 

C 

0 

12 

12 

1.12 

0.28 

0.84 

-0.09 

K0A211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOA212 

* 

-1 

1271 

96 

1.37 

0.04 

0.00 

-0.05 

KOA212 

A 

1 

44 

92 

1.86 

0.16 

0.96 

0.36 

KOA212 

B 

0 

2 

4 

0.41 

0.09 

0.41 

-0.25 

KOA212 

C 

0 

2 

4 

0.46 

0.83 

0.59 

-0.24 

KOA212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA213 

* 

-1 

1267 

96 

1.36 

0.04 

0.00 

-0.06 

KOA213 

A 

1 

23 

44 

2.57 

0.23 

0.76 

0.56 

KOA213 

B 

0 

21 

40 

1.41 

0.19 

0.94 

-0.30 

KOA213 

C 

0 

8 

15 

0.81 

0.26 

0.47 

-0.37 

KOA213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA214 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

KOA214 

A 

1 

14 

29 

1.92 

0.21 

0.71 

0.54 

KOA214 

B 

0 

23 

48 

0.85 

0.21 

0.99 

-0.22 

KOA214 

C 

0 

11 

23 

0.48 

0.18 

0.54 

-0.32 

KOA214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA215 

* 

-1 

1272 

96 

1.38 

0.04 

0.00 

-0.01 

KOA215 

A 

1 

40 

85 

1.63 

0.18 

0.91 

0.38 

KOA215 

B 

0 

4 

9 

0.72 

0.47 

1.01 

-0.19 

KOA215 

C 

0 

3 

6 

-0.05 

0.39 

0.39 

-0.33 

KOA215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA216 

* 

-1 

1270 

96 

1.38 

0.04 

0.00 

-0.01 

KOA216 

A 

1 

9 

18 

1.91 

0.38 

1.30 

0.24 

KOA216 

B 

0 

26 

53 

1.49 

0.18 

1.25 

0.04 

KOA216 

C 

0 

14 

29 

1.09 

0.18 

0.66 

-0.25 

KOA216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOA217 

* 

-1 

1271 

96 

1.38 

0.04 

0.00 

-0.01 

KOA217 

A 

1 

37 

77 

1.76 

0.20 

1.08 

0.41 

KOA217 

B 

0 

2 

4 

0.18 

0.62 

0.48 

-0.21 

KOA217 

C 

0 

9 

19 

0.59 

0.35 

1.19 

-0.33 

KOA217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA32 

* 

-1 

1222 

93 

1.41 

0.04 

0.00 

0.06 

KOA32 

A 

1 

57 

59 

1.43 

0.11 

0.82 

0.53 

KOA32 

B 

0 

24 

25 

0.53 

0.16 

0.86 

-0.33 

KOA32 

C 

0 

16 

16 

0.39 

0.15 

0.67 

-0.32 

KOA32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

K0A41 

* 

-1 

1219 

92 

1.39 

0.04 

0.00 

0.03 

K0A41 

A 

1 

54 

54 

1.61 

0.19 

1.10 

0.33 

K0A41 

B 

0 

15 

15 

0.75 

0.29 

1.21 

-0.17 

K0A41 

C 

0 

31 

31 

0.83 

0.13 

0.98 

-0.22 

K0A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA412 

* 

-1 

1218 

92 

1.37 

0.04 

0.00 

-0.02 

KOA412 

A 

1 

44 

44 

2.06 

0.20 

1.17 

0.41 

KOA412 

B 

0 

20 

20 

1.30 

0.21 

1.19 

-0.09 

KOA412 

C 

0 

37 

37 

0.95 

0.15 

0.81 

-0.35 

KOA412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

KOA514 

* 

-1 

1220 

92 

1.38 

0.04 

0.00 

-0.01 

KOA514 

A 

1 

26 

26 

2.18 

0.28 

1.32 

0.43 

KOA514 

B 

0 

47 

47 

1.27 

0.11 

0.94 

-0.14 

KOA514 

C 

0 

26 

26 

0.94 

0.14 

0.66 

-0.27 

KOA514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n% 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

KOA517 

* 

-1 

1220 

92 

1.40 

0.04 

0.00 

0.03 

KOA517 

A 

1 

71 

72 

1.54 

0.16 

1.05 

0.40 

KOA517 

B 

0 

8 

8 

0.06 

0.27 

0.62 

-0.25 

KOA517 

C 

0 

20 

20 

0.45 

0.21 

0.91 

-0.28 

KOA517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



